2024-09-11T00:32:17.303 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T00:32:17.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:32:17.436 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/ffsb}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899851' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWUfU+JYJFZoDIXAZEtgbyRxQgACp/YKQN4KzRyXWysMDr3liyA7aX1/VhptGnfEkeXCs37rE4ooj9xBn6A+oc= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXtXo2T8S3DRwoUuIACr/0x3IgLpaqHvgoPhzS4m/yziy/cW2YhVMm+q7pPsFdVIhPJS5xGjDdMYtIYWmbjzrQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T00:32:17.436 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-11T00:32:17.437 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-11T00:32:17.437 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T00:32:17.438 INFO:teuthology.task.internal:Checking packages... 2024-09-11T00:32:17.460 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-11T00:32:17.461 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T00:32:17.461 INFO:teuthology.packaging:ref: None 2024-09-11T00:32:17.461 INFO:teuthology.packaging:tag: None 2024-09-11T00:32:17.461 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:32:17.461 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:32:17.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:32:17.623 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-11T00:32:17.625 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T00:32:17.631 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T00:32:17.631 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T00:32:17.643 INFO:teuthology.task.internal:Saving configuration 2024-09-11T00:32:17.659 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T00:32:17.665 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T00:32:17.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:27:06.423022', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWUfU+JYJFZoDIXAZEtgbyRxQgACp/YKQN4KzRyXWysMDr3liyA7aX1/VhptGnfEkeXCs37rE4ooj9xBn6A+oc='} 2024-09-11T00:32:17.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:27:06.424589', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXtXo2T8S3DRwoUuIACr/0x3IgLpaqHvgoPhzS4m/yziy/cW2YhVMm+q7pPsFdVIhPJS5xGjDdMYtIYWmbjzrQ='} 2024-09-11T00:32:17.725 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T00:32:17.731 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-11T00:32:17.732 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-11T00:32:17.732 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T00:32:17.809 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1878553be0>, signals=[15]) 2024-09-11T00:32:17.809 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T00:32:17.815 INFO:teuthology.task.internal:Opening connections... 2024-09-11T00:32:17.815 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:32:17.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:32:17.900 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:32:17.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:32:17.985 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T00:32:17.991 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-11T00:32:18.009 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-11T00:32:18.010 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:32:18.068 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:32:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:32:18.070 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-11T00:32:18.095 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-11T00:32:18.113 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-11T00:32:18.114 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-11T00:32:18.171 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:32:18.172 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:32:18.172 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-11T00:32:18.203 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T00:32:18.213 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T00:32:18.246 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T00:32:18.246 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:32:18.249 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:32:18.265 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T00:32:18.272 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T00:32:18.272 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:32:18.306 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:32:18.405 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T00:32:18.473 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T00:32:18.487 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-11T00:32:18.487 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-11T00:32:18.488 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:32:18.488 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:32:18.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:32:18.505 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T00:32:18.506 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-11T00:32:18.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:32:18.507 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.507 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T00:32:18.507 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-11T00:32:18.563 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:32:18.563 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.564 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T00:32:18.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.576 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:32:18.576 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.576 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T00:32:18.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:18.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum upgrade -y linux-firmware 2024-09-11T00:32:18.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2024-09-11T00:32:20.843 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T00:32:22.800 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-11T00:32:24.643 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-11T00:32:25.528 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-11T00:32:30.136 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-11T00:32:30.895 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-11T00:32:32.045 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-11T00:32:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-11T00:32:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-11T00:32:33.398 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-11T00:32:38.721 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-11T00:32:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T00:32:40.808 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-11T00:32:40.809 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-11T00:32:40.809 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-11T00:32:40.900 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-11T00:32:40.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-11T00:32:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-11T00:32:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-11T00:32:41.061 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T00:32:41.062 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T00:32:41.065 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-09-11T00:32:41.119 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-11T00:32:41.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:32:41.273 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T00:32:41.273 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T00:32:41.275 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi167.front.sepia.ceph.com to complete... 2024-09-11T00:32:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11 00:32:53 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T00:32:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2024-09-11 00:32:53-- 2024-09-11T00:32:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 13s 2024-09-11T00:32:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 343M in 13s (27.3 MB/s) 2024-09-11T00:32:53.935 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-11T00:32:53.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T00:32:56.034 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2024-09-11T00:32:56.175 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2024-09-11T00:32:56.284 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2024-09-11T00:33:01.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11 00:33:01 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T00:33:01.019 INFO:teuthology.orchestra.run.smithi167.stderr:FINISHED --2024-09-11 00:33:01-- 2024-09-11T00:33:01.019 INFO:teuthology.orchestra.run.smithi167.stderr:Total wall clock time: 20s 2024-09-11T00:33:01.019 INFO:teuthology.orchestra.run.smithi167.stderr:Downloaded: 1 files, 343M in 19s (17.7 MB/s) 2024-09-11T00:33:01.022 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-11T00:33:01.022 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T00:33:03.132 INFO:teuthology.orchestra.run.smithi167.stdout:Verifying... ######################################## 2024-09-11T00:33:03.307 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing... ######################################## 2024-09-11T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout:Updating / installing... 2024-09-11T00:33:04.287 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T00:33:11.476 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T00:33:44.146 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T00:33:44.147 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T00:33:44.317 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T00:33:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T00:33:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T00:33:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T00:33:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T00:33:44.322 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T00:33:44.323 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T00:33:44.324 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T00:33:44.325 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T00:33:44.326 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T00:33:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T00:33:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T00:33:44.329 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T00:33:44.330 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T00:33:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T00:33:44.332 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T00:33:44.333 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T00:33:44.334 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T00:33:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T00:33:44.336 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T00:33:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T00:33:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T00:33:44.339 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T00:33:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T00:33:44.341 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T00:33:44.342 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T00:33:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T00:33:44.344 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T00:33:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T00:33:44.346 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T00:33:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T00:33:44.348 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T00:33:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T00:33:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T00:33:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T00:33:44.352 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T00:33:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T00:33:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T00:33:44.355 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T00:33:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T00:33:44.357 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T00:33:44.358 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T00:33:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T00:33:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T00:33:44.361 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T00:33:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T00:33:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T00:33:44.364 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T00:33:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T00:33:44.366 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T00:33:44.367 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T00:33:44.368 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T00:33:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T00:33:44.370 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T00:33:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T00:33:44.372 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T00:33:44.373 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T00:33:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T00:33:44.375 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T00:33:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T00:33:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T00:33:44.378 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T00:33:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T00:33:44.380 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T00:33:44.381 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T00:33:44.382 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:33:44.386 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.387 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout:for file in vmlinuz System.map config; do 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T00:33:44.413 INFO:teuthology.orchestra.run.smithi081.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: fi 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-11T00:33:44.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-11T00:33:44.493 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:33:44.494 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:33:44.495 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:33:44.496 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:33:44.496 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:44.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:33:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-11T00:33:46.569 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:33:46.595 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-11T00:33:46.598 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-11T00:33:46.641 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.MOyMHUs9Ke 2024-09-11T00:33:46.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MOyMHUs9Ke 2024-09-11T00:33:46.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.MOyMHUs9Ke 2024-09-11T00:33:46.840 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.MOyMHUs9Ke is 6KB 2024-09-11T00:33:46.889 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.MOyMHUs9Ke 2024-09-11T00:33:46.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:33:46.965 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:33:46.965 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:33:46.966 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:33:46.966 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T00:33:46.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:47.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-11T00:33:51.825 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T00:33:51.825 DEBUG:teuthology.orchestra.run.smithi167:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T00:33:51.951 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T00:33:51.952 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T00:33:51.953 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T00:33:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T00:33:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T00:33:51.956 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T00:33:51.957 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T00:33:51.958 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T00:33:51.959 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T00:33:51.960 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T00:33:51.961 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T00:33:51.962 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T00:33:51.963 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T00:33:51.964 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T00:33:51.965 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T00:33:51.966 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T00:33:51.967 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T00:33:51.968 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T00:33:51.969 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T00:33:51.970 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T00:33:51.971 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T00:33:51.972 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T00:33:51.973 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T00:33:51.974 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T00:33:51.975 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T00:33:51.976 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T00:33:51.977 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T00:33:51.978 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T00:33:51.979 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T00:33:51.980 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T00:33:51.981 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T00:33:51.982 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T00:33:51.983 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T00:33:51.984 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T00:33:51.985 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T00:33:51.986 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T00:33:51.987 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T00:33:51.988 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T00:33:51.989 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T00:33:51.990 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T00:33:51.991 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T00:33:51.992 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T00:33:51.993 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T00:33:51.994 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T00:33:51.995 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T00:33:51.996 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T00:33:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T00:33:51.998 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T00:33:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T00:33:52.000 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T00:33:52.001 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T00:33:52.002 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T00:33:52.003 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T00:33:52.004 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T00:33:52.005 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T00:33:52.006 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T00:33:52.007 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T00:33:52.008 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T00:33:52.009 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T00:33:52.010 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T00:33:52.011 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T00:33:52.012 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T00:33:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T00:33:52.014 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T00:33:52.015 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T00:33:52.016 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T00:33:52.017 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T00:33:52.018 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T00:33:52.019 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T00:33:52.020 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T00:33:52.021 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T00:33:52.022 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T00:33:52.023 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T00:33:52.024 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T00:33:52.025 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T00:33:52.026 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T00:33:52.027 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T00:33:52.028 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T00:33:52.029 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T00:33:52.030 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T00:33:52.031 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T00:33:52.032 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T00:33:52.033 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T00:33:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T00:33:52.035 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T00:33:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T00:33:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T00:33:52.038 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T00:33:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T00:33:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T00:33:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T00:33:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T00:33:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T00:33:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T00:33:52.045 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T00:33:52.046 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T00:33:52.047 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T00:33:52.048 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T00:33:52.049 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T00:33:52.050 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T00:33:52.051 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T00:33:52.052 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T00:33:52.053 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T00:33:52.054 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T00:33:52.055 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T00:33:52.056 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T00:33:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T00:33:52.058 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T00:33:52.059 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T00:33:52.059 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T00:33:52.060 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T00:33:52.061 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T00:33:52.062 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T00:33:52.063 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T00:33:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T00:33:52.065 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T00:33:52.066 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T00:33:52.067 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T00:33:52.068 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T00:33:52.069 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T00:33:52.070 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T00:33:52.071 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T00:33:52.072 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T00:33:52.073 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T00:33:52.074 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T00:33:52.075 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T00:33:52.076 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T00:33:52.077 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T00:33:52.078 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T00:33:52.079 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T00:33:52.080 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T00:33:52.081 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T00:33:52.082 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T00:33:52.083 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T00:33:52.084 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T00:33:52.085 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T00:33:52.086 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T00:33:52.087 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T00:33:52.088 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:33:52.092 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:52.092 DEBUG:teuthology.orchestra.run.smithi167:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:for file in vmlinuz System.map config; do 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout: fi 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:done 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T00:33:52.117 INFO:teuthology.orchestra.run.smithi167.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:52.118 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-09-11T00:33:52.119 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-11T00:33:52.201 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-11T00:33:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:33:52.203 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:33:52.204 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:33:52.204 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:52.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:33:52.777 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-11T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:33:54.177 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-11T00:33:54.179 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T00:33:54.195 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.wv666lDySk 2024-09-11T00:33:54.195 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wv666lDySk 2024-09-11T00:33:54.262 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.wv666lDySk 2024-09-11T00:33:54.400 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.wv666lDySk is 6KB 2024-09-11T00:33:54.449 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.wv666lDySk 2024-09-11T00:33:54.464 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:33:54.527 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:33:54.527 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:33:54.527 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:33:54.527 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T00:33:54.528 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:33:54.683 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-11T00:34:17.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T00:34:17.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:34:17.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:34:24.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T00:34:24.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:34:24.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:34:51.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-11T00:34:59.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-11T00:35:00.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:35:00.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:35:08.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:35:08.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:35:19.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-11T00:35:31.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:35:31.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:35:32.273 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-11T00:35:32.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:35:32.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T00:35:32.890 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-11T00:35:32.942 INFO:teuthology.orchestra.run.smithi081.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:35:32.942 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:35:32.942 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:35:32.942 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:35:33.944 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T00:35:33.944 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T00:35:34.074 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-11T00:35:34.106 DEBUG:teuthology.parallel:result is None 2024-09-11T00:36:08.287 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T00:36:20.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:36:20.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:36:20.710 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-11T00:36:21.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:36:21.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T00:36:21.196 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-11T00:36:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:36:21.231 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:36:21.231 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:36:21.231 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:36:22.232 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T00:36:22.232 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T00:36:22.334 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-11T00:36:22.365 DEBUG:teuthology.parallel:result is None 2024-09-11T00:36:22.366 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T00:36:22.374 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T00:36:22.374 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:36:22.379 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:36:22.416 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T00:36:22.445 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T00:36:22.456 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T00:36:22.457 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:36:22.461 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:36:22.515 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T00:36:22.524 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T00:36:22.524 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:36:22.547 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:36:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:36:22.614 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:36:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:36:22.636 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:36:22.640 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T00:36:22.648 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T00:36:22.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:36:22.652 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:36:22.707 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T00:36:22.717 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T00:36:22.718 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:36:22.721 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:36:22.756 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:36:22.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:36:22.963 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:36:23.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:36:23.095 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:36:23.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:36:23.150 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:36:23.221 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:36:23.320 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:36:23.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:36:23.452 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:36:23.453 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:36:23.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-11T00:36:23.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-11T00:36:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:36:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:36:24.028 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T00:36:24.036 INFO:teuthology.task.internal:Starting timer... 2024-09-11T00:36:24.036 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T00:36:24.060 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T00:36:24.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-11T00:36:24.177 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-11T00:36:24.180 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-11T00:36:24.285 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-11T00:36:24.288 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T00:36:24.288 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-11T00:36:24.328 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-11T00:36:24.328 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-11T00:36:24.372 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-11T00:36:24.372 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-11T00:36:24.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:36:24.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:36:24.429 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:36:24.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:36:24.487 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T00:36:24.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:36:24.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:36:24.624 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T00:36:24.633 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T00:36:24.636 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T00:36:24.759 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T00:36:24.770 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T00:36:24.771 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T00:41:09.040 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-11T00:41:09.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:41:09.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:41:09.141 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-11T00:41:09.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-11T00:41:09.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:41:09.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:41:09.354 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-11T00:41:09.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T00:41:09.460 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T00:41:09.473 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T00:41:09.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:41:09.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:41:09.477 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:41:09.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:41:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:41:09.562 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:41:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:41:09.592 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:41:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-11T00:41:09.638 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-11T00:41:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-11T00:41:09.666 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-11T00:41:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:41:09.696 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:41:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:41:09.726 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:41:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:41:09.838 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:41:09.839 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-11T00:41:09.839 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.839 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.839 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.839 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:41:09.840 INFO:teuthology.run_tasks:Running task install... 2024-09-11T00:41:09.848 DEBUG:teuthology.task.install:project ceph 2024-09-11T00:41:09.848 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T00:41:09.848 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T00:41:09.848 INFO:teuthology.task.install:Using flavor: default 2024-09-11T00:41:09.854 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T00:41:09.854 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T00:41:09.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:41:09.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:41:09.857 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:41:09.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:41:10.029 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:41:10.029 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:41:10.041 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:41:10.041 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:41:10.147 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:41:10.147 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:41:10.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:41:10.161 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:41:10.161 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:41:10.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:41:10.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:41:10.203 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:41:10.218 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:41:10.219 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:41:10.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:41:10.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:41:10.378 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:41:10.394 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:41:10.433 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-11T00:41:10.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-11T00:41:10.449 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-11T00:41:10.452 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-11T00:41:10.713 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-11T00:41:10.722 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-11T00:41:10.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:41:10.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:41:11.414 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-11T00:41:11.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-11T00:41:11.715 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-11T00:41:11.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-11T00:41:12.007 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-11T00:41:12.665 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T00:41:14.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 807 B/s | 1.9 kB 00:02 2024-09-11T00:41:14.467 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-11T00:41:16.779 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-11T00:41:19.109 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T00:41:20.935 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-11T00:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-11T00:41:25.196 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-11T00:41:28.420 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T00:41:29.830 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T00:41:30.875 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:41:30.875 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:41:30.887 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:41:30.888 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:41:30.889 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:41:30.890 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:41:30.892 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:41:30.894 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:41:30.895 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:41:30.961 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:41:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:41:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:41:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:41:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:41:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:41:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:41:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:41:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:41:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:41:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:41:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:41:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:41:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:41:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:41:30.995 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 240 M 2024-09-11T00:41:30.996 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-11T00:41:31.322 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 57 kB/s | 6.6 kB 00:00 2024-09-11T00:41:31.530 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.2 MB/s | 900 kB 00:00 2024-09-11T00:41:31.597 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-11T00:41:31.606 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-11T00:41:31.681 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-11T00:41:31.806 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-11T00:41:31.848 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 9.2 MB/s | 1.5 MB 00:00 2024-09-11T00:41:32.174 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-11T00:41:32.565 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 16 MB/s | 22 MB 00:01 2024-09-11T00:41:32.616 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-11T00:41:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-11T00:41:32.941 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 16 MB/s | 17 MB 00:01 2024-09-11T00:41:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-11T00:41:33.133 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-11T00:41:33.175 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 407 kB/s | 27 kB 00:00 2024-09-11T00:41:33.200 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 475 kB/s | 32 kB 00:00 2024-09-11T00:41:33.251 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-11T00:41:33.284 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 6.8 MB/s | 755 kB 00:00 2024-09-11T00:41:33.309 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-11T00:41:33.343 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-11T00:41:33.402 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 774 kB/s | 45 kB 00:00 2024-09-11T00:41:33.477 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-11T00:41:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.4 MB/s | 161 kB 00:00 2024-09-11T00:41:33.644 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-11T00:41:33.670 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 2.5 MB/s | 321 kB 00:00 2024-09-11T00:41:33.695 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-11T00:41:33.720 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T00:41:33.746 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T00:41:33.796 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.4 MB/s | 171 kB 00:00 2024-09-11T00:41:33.863 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 515 kB/s | 34 kB 00:00 2024-09-11T00:41:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 15 MB/s | 3.2 MB 00:00 2024-09-11T00:41:33.955 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.6 MB/s | 154 kB 00:00 2024-09-11T00:41:34.463 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-11T00:41:34.530 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.3 MB/s | 291 kB 00:00 2024-09-11T00:41:34.597 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 743 kB/s | 49 kB 00:00 2024-09-11T00:41:34.656 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 282 kB/s | 16 kB 00:00 2024-09-11T00:41:34.839 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 16 MB/s | 14 MB 00:00 2024-09-11T00:41:34.873 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 285 kB 00:00 2024-09-11T00:41:35.349 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 18 MB/s | 50 MB 00:02 2024-09-11T00:41:35.374 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 36 kB/s | 18 kB 00:00 2024-09-11T00:41:35.408 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 1.3 MB/s | 783 kB 00:00 2024-09-11T00:41:35.516 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-11T00:41:35.583 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-11T00:41:35.608 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-11T00:41:35.667 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-11T00:41:35.700 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-11T00:41:35.734 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-11T00:41:35.768 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-11T00:41:35.793 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T00:41:35.860 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-11T00:41:35.927 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-11T00:41:35.969 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-11T00:41:36.011 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-11T00:41:36.045 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-11T00:41:36.070 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): boost-program-options-1.75.0-8.el9.x8 511 kB/s | 107 kB 00:00 2024-09-11T00:41:36.112 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-11T00:41:36.154 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-11T00:41:36.196 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-11T00:41:36.271 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-11T00:41:36.296 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-11T00:41:36.322 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-11T00:41:36.372 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-11T00:41:36.405 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-11T00:41:36.431 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-11T00:41:36.498 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-11T00:41:36.540 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-09-11T00:41:36.565 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-11T00:41:36.590 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-11T00:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-11T00:41:36.757 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-11T00:41:36.849 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-11T00:41:36.908 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-09-11T00:41:36.933 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-11T00:41:36.967 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-11T00:41:37.026 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-11T00:41:37.050 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-11T00:41:37.134 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-11T00:41:37.185 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 457 kB/s | 61 kB 00:00 2024-09-11T00:41:37.210 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-11T00:41:37.294 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 308 kB/s | 26 kB 00:00 2024-09-11T00:41:37.385 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-11T00:41:37.411 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-11T00:41:37.436 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 990 kB/s | 248 kB 00:00 2024-09-11T00:41:37.461 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-11T00:41:37.486 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-11T00:41:37.528 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-11T00:41:37.553 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-11T00:41:37.646 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-11T00:41:37.671 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-11T00:41:37.696 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 462 kB/s | 77 kB 00:00 2024-09-11T00:41:37.721 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-11T00:41:37.747 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-11T00:41:37.780 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-11T00:41:37.806 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-11T00:41:37.831 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-09-11T00:41:37.873 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-11T00:41:37.906 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 585 kB/s | 44 kB 00:00 2024-09-11T00:41:37.957 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-11T00:41:37.973 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-11T00:41:38.024 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-11T00:41:38.057 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-11T00:41:38.082 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-11T00:41:38.108 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T00:41:38.300 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-11T00:41:38.325 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 206 kB/s | 45 kB 00:00 2024-09-11T00:41:38.350 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 238 kB/s | 64 kB 00:00 2024-09-11T00:41:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T00:41:38.443 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:41:38.468 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-11T00:41:38.594 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-11T00:41:38.635 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-11T00:41:38.661 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T00:41:38.686 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T00:41:38.711 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-09-11T00:41:38.762 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-11T00:41:38.795 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T00:41:38.821 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T00:41:38.845 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:41:38.871 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-11T00:41:38.896 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-11T00:41:38.930 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-11T00:41:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-09-11T00:41:38.955 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-11T00:41:39.005 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-09-11T00:41:39.039 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-11T00:41:39.072 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T00:41:39.098 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-11T00:41:39.123 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-11T00:41:39.148 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-11T00:41:39.173 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-11T00:41:39.199 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-11T00:41:39.266 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.9 MB/s | 2.0 MB 00:00 2024-09-11T00:41:39.291 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:41:39.316 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:41:39.358 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-11T00:41:39.400 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 692 kB/s | 58 kB 00:00 2024-09-11T00:41:39.442 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): protobuf-compiler-3.14.0-13.el9.x86_ 773 kB/s | 863 kB 00:01 2024-09-11T00:41:39.485 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-09-11T00:41:39.535 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 699 kB/s | 28 kB 00:00 2024-09-11T00:41:39.560 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-11T00:41:39.602 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 473 kB/s | 31 kB 00:00 2024-09-11T00:41:39.628 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 486 kB/s | 90 kB 00:00 2024-09-11T00:41:39.669 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 888 kB/s | 59 kB 00:00 2024-09-11T00:41:39.711 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 429 kB/s | 36 kB 00:00 2024-09-11T00:41:39.737 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-11T00:41:39.761 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 807 kB/s | 74 kB 00:00 2024-09-11T00:41:39.787 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T00:41:39.837 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-11T00:41:39.887 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-09-11T00:41:39.921 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T00:41:39.955 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-09-11T00:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T00:41:40.155 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-09-11T00:41:40.214 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.5 MB 00:00 2024-09-11T00:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.9 MB/s | 3.2 MB 00:00 2024-09-11T00:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-11T00:41:40.356 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-11T00:41:40.398 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 7.4 MB/s | 1.8 MB 00:00 2024-09-11T00:41:40.440 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-11T00:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-11T00:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout:Total 25 MB/s | 240 MB 00:09 2024-09-11T00:41:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:41:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:41:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:41:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:41:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:41:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:41:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:41:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:41:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:41:41.547 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:41:41.578 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:41:41.579 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:41:41.580 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:41:41.581 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:41:41.582 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:41:41.583 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:41:41.584 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:41:41.585 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:41:41.586 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:41:41.587 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:41:41.588 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:41:41.589 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:41:41.590 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout:Install 149 Packages 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 240 M 2024-09-11T00:41:41.591 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-11T00:41:42.302 INFO:teuthology.orchestra.run.smithi167.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-09-11T00:41:42.485 INFO:teuthology.orchestra.run.smithi167.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-11T00:41:42.553 INFO:teuthology.orchestra.run.smithi167.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-11T00:41:42.632 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-11T00:41:42.785 INFO:teuthology.orchestra.run.smithi167.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 8.7 MB/s | 5.5 MB 00:00 2024-09-11T00:41:42.818 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-11T00:41:42.819 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-11T00:41:42.836 INFO:teuthology.orchestra.run.smithi167.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 8.4 MB/s | 2.4 MB 00:00 2024-09-11T00:41:42.903 INFO:teuthology.orchestra.run.smithi167.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-11T00:41:43.229 INFO:teuthology.orchestra.run.smithi167.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-11T00:41:43.454 INFO:teuthology.orchestra.run.smithi167.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-11T00:41:43.521 INFO:teuthology.orchestra.run.smithi167.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 378 kB/s | 25 kB 00:00 2024-09-11T00:41:43.994 INFO:teuthology.orchestra.run.smithi167.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 14 MB/s | 11 MB 00:00 2024-09-11T00:41:44.196 INFO:teuthology.orchestra.run.smithi167.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 17 MB 00:01 2024-09-11T00:41:44.221 INFO:teuthology.orchestra.run.smithi167.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 992 kB/s | 225 kB 00:00 2024-09-11T00:41:44.263 INFO:teuthology.orchestra.run.smithi167.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 406 kB/s | 27 kB 00:00 2024-09-11T00:41:44.306 INFO:teuthology.orchestra.run.smithi167.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 380 kB/s | 32 kB 00:00 2024-09-11T00:41:44.389 INFO:teuthology.orchestra.run.smithi167.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-11T00:41:44.423 INFO:teuthology.orchestra.run.smithi167.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.4 MB/s | 162 kB 00:00 2024-09-11T00:41:44.439 INFO:teuthology.orchestra.run.smithi167.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:41:44.482 INFO:teuthology.orchestra.run.smithi167.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-11T00:41:44.566 INFO:teuthology.orchestra.run.smithi167.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 542 kB/s | 45 kB 00:00 2024-09-11T00:41:44.641 INFO:teuthology.orchestra.run.smithi167.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-11T00:41:44.724 INFO:teuthology.orchestra.run.smithi167.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 5.5 MB 00:00 2024-09-11T00:41:44.750 INFO:teuthology.orchestra.run.smithi167.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.5 MB/s | 161 kB 00:00 2024-09-11T00:41:44.800 INFO:teuthology.orchestra.run.smithi167.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 4.2 MB/s | 321 kB 00:00 2024-09-11T00:41:44.825 INFO:teuthology.orchestra.run.smithi167.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-11T00:41:44.850 INFO:teuthology.orchestra.run.smithi167.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T00:41:44.876 INFO:teuthology.orchestra.run.smithi167.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T00:41:44.926 INFO:teuthology.orchestra.run.smithi167.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-11T00:41:45.002 INFO:teuthology.orchestra.run.smithi167.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 21 MB/s | 3.2 MB 00:00 2024-09-11T00:41:45.044 INFO:teuthology.orchestra.run.smithi167.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 293 kB/s | 34 kB 00:00 2024-09-11T00:41:45.069 INFO:teuthology.orchestra.run.smithi167.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-11T00:41:45.267 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-11T00:41:45.267 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-11T00:41:45.519 INFO:teuthology.orchestra.run.smithi167.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-11T00:41:45.603 INFO:teuthology.orchestra.run.smithi167.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.4 MB/s | 291 kB 00:00 2024-09-11T00:41:45.695 INFO:teuthology.orchestra.run.smithi167.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 538 kB/s | 49 kB 00:00 2024-09-11T00:41:45.854 INFO:teuthology.orchestra.run.smithi167.stdout:(34/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 17 MB/s | 14 MB 00:00 2024-09-11T00:41:45.904 INFO:teuthology.orchestra.run.smithi167.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 79 kB/s | 16 kB 00:00 2024-09-11T00:41:45.929 INFO:teuthology.orchestra.run.smithi167.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.7 MB/s | 285 kB 00:00 2024-09-11T00:41:45.993 INFO:teuthology.orchestra.run.smithi167.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 8.7 MB/s | 783 kB 00:00 2024-09-11T00:41:46.063 INFO:teuthology.orchestra.run.smithi167.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 136 kB/s | 18 kB 00:00 2024-09-11T00:41:46.242 INFO:teuthology.orchestra.run.smithi167.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 325 kB/s | 80 kB 00:00 2024-09-11T00:41:46.714 INFO:teuthology.orchestra.run.smithi167.stdout:(40/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 16 MB/s | 50 MB 00:03 2024-09-11T00:41:46.731 INFO:teuthology.orchestra.run.smithi167.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 389 kB/s | 191 kB 00:00 2024-09-11T00:41:46.840 INFO:teuthology.orchestra.run.smithi167.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-11T00:41:46.882 INFO:teuthology.orchestra.run.smithi167.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-09-11T00:41:46.940 INFO:teuthology.orchestra.run.smithi167.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-11T00:41:46.966 INFO:teuthology.orchestra.run.smithi167.stdout:(45/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-11T00:41:46.991 INFO:teuthology.orchestra.run.smithi167.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-11T00:41:47.017 INFO:teuthology.orchestra.run.smithi167.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-11T00:41:47.041 INFO:teuthology.orchestra.run.smithi167.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T00:41:47.492 INFO:teuthology.orchestra.run.smithi167.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 237 kB/s | 107 kB 00:00 2024-09-11T00:41:47.642 INFO:teuthology.orchestra.run.smithi167.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 145 kB/s | 22 kB 00:00 2024-09-11T00:41:47.801 INFO:teuthology.orchestra.run.smithi167.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 851 kB/s | 689 kB 00:00 2024-09-11T00:41:47.926 INFO:teuthology.orchestra.run.smithi167.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-11T00:41:47.952 INFO:teuthology.orchestra.run.smithi167.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-11T00:41:48.015 INFO:teuthology.orchestra.run.smithi167.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 945 kB/s | 943 kB 00:00 2024-09-11T00:41:48.086 INFO:teuthology.orchestra.run.smithi167.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 18 kB 00:00 2024-09-11T00:41:48.144 INFO:teuthology.orchestra.run.smithi167.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 86 kB/s | 11 kB 00:00 2024-09-11T00:41:48.203 INFO:teuthology.orchestra.run.smithi167.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-11T00:41:48.264 INFO:teuthology.orchestra.run.smithi167.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-11T00:41:48.337 INFO:teuthology.orchestra.run.smithi167.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-09-11T00:41:48.426 INFO:teuthology.orchestra.run.smithi167.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.0 MB/s | 3.0 MB 00:00 2024-09-11T00:41:48.473 INFO:teuthology.orchestra.run.smithi167.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-11T00:41:48.554 INFO:teuthology.orchestra.run.smithi167.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 192 kB/s | 24 kB 00:00 2024-09-11T00:41:48.596 INFO:teuthology.orchestra.run.smithi167.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-11T00:41:48.630 INFO:teuthology.orchestra.run.smithi167.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-11T00:41:48.672 INFO:teuthology.orchestra.run.smithi167.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T00:41:48.714 INFO:teuthology.orchestra.run.smithi167.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T00:41:48.764 INFO:teuthology.orchestra.run.smithi167.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-11T00:41:48.998 INFO:teuthology.orchestra.run.smithi167.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-11T00:41:49.131 INFO:teuthology.orchestra.run.smithi167.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-11T00:41:49.248 INFO:teuthology.orchestra.run.smithi167.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-11T00:41:49.824 INFO:teuthology.orchestra.run.smithi167.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-11T00:41:49.957 INFO:teuthology.orchestra.run.smithi167.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-11T00:41:50.074 INFO:teuthology.orchestra.run.smithi167.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 749 kB/s | 87 kB 00:00 2024-09-11T00:41:50.349 INFO:teuthology.orchestra.run.smithi167.stdout:(74/157): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-11T00:41:50.466 INFO:teuthology.orchestra.run.smithi167.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 526 kB/s | 61 kB 00:00 2024-09-11T00:41:50.583 INFO:teuthology.orchestra.run.smithi167.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-11T00:41:50.701 INFO:teuthology.orchestra.run.smithi167.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-11T00:41:50.834 INFO:teuthology.orchestra.run.smithi167.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-09-11T00:41:50.943 INFO:teuthology.orchestra.run.smithi167.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-11T00:41:51.076 INFO:teuthology.orchestra.run.smithi167.stdout:(80/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-11T00:41:51.102 INFO:teuthology.orchestra.run.smithi167.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-11T00:41:51.185 INFO:teuthology.orchestra.run.smithi167.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-11T00:41:51.369 INFO:teuthology.orchestra.run.smithi167.stdout:(83/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-11T00:41:51.486 INFO:teuthology.orchestra.run.smithi167.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-11T00:41:51.570 INFO:teuthology.orchestra.run.smithi167.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 653 kB/s | 250 kB 00:00 2024-09-11T00:41:51.626 INFO:teuthology.orchestra.run.smithi167.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 550 kB/s | 77 kB 00:00 2024-09-11T00:41:51.737 INFO:teuthology.orchestra.run.smithi167.stdout:(87/157): postgresql-server-13.16-1.el9.x86_64. 2.3 MB/s | 5.8 MB 00:02 2024-09-11T00:41:51.762 INFO:teuthology.orchestra.run.smithi167.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 220 kB/s | 42 kB 00:00 2024-09-11T00:41:51.787 INFO:teuthology.orchestra.run.smithi167.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-09-11T00:41:51.846 INFO:teuthology.orchestra.run.smithi167.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-11T00:41:51.880 INFO:teuthology.orchestra.run.smithi167.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-11T00:41:51.905 INFO:teuthology.orchestra.run.smithi167.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-11T00:41:51.955 INFO:teuthology.orchestra.run.smithi167.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 492 kB/s | 54 kB 00:00 2024-09-11T00:41:52.039 INFO:teuthology.orchestra.run.smithi167.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-11T00:41:52.064 INFO:teuthology.orchestra.run.smithi167.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-11T00:41:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-11T00:41:52.156 INFO:teuthology.orchestra.run.smithi167.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T00:41:52.181 INFO:teuthology.orchestra.run.smithi167.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-11T00:41:52.265 INFO:teuthology.orchestra.run.smithi167.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-11T00:41:52.307 INFO:teuthology.orchestra.run.smithi167.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-11T00:41:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:41:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:41:52.374 INFO:teuthology.orchestra.run.smithi167.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-11T00:41:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:41:52.441 INFO:teuthology.orchestra.run.smithi167.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 716 kB/s | 96 kB 00:00 2024-09-11T00:41:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:41:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:41:52.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:41:52.617 INFO:teuthology.orchestra.run.smithi167.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-11T00:41:52.633 INFO:teuthology.orchestra.run.smithi167.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-11T00:41:52.650 INFO:teuthology.orchestra.run.smithi167.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 230 kB/s | 64 kB 00:00 2024-09-11T00:41:52.751 INFO:teuthology.orchestra.run.smithi167.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-11T00:41:52.768 INFO:teuthology.orchestra.run.smithi167.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-11T00:41:52.918 INFO:teuthology.orchestra.run.smithi167.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-09-11T00:41:52.943 INFO:teuthology.orchestra.run.smithi167.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 111 kB/s | 19 kB 00:00 2024-09-11T00:41:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:41:52.968 INFO:teuthology.orchestra.run.smithi167.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T00:41:52.994 INFO:teuthology.orchestra.run.smithi167.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T00:41:53.019 INFO:teuthology.orchestra.run.smithi167.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-11T00:41:53.053 INFO:teuthology.orchestra.run.smithi167.stdout:(112/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-11T00:41:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:41:53.095 INFO:teuthology.orchestra.run.smithi167.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-11T00:41:53.145 INFO:teuthology.orchestra.run.smithi167.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-11T00:41:53.170 INFO:teuthology.orchestra.run.smithi167.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T00:41:53.195 INFO:teuthology.orchestra.run.smithi167.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:41:53.226 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:41:53.238 INFO:teuthology.orchestra.run.smithi167.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-11T00:41:53.258 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:41:53.280 INFO:teuthology.orchestra.run.smithi167.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-11T00:41:53.313 INFO:teuthology.orchestra.run.smithi167.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-11T00:41:53.347 INFO:teuthology.orchestra.run.smithi167.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-09-11T00:41:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:41:53.372 INFO:teuthology.orchestra.run.smithi167.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T00:41:53.397 INFO:teuthology.orchestra.run.smithi167.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T00:41:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:41:53.423 INFO:teuthology.orchestra.run.smithi167.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T00:41:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:41:53.448 INFO:teuthology.orchestra.run.smithi167.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-11T00:41:53.473 INFO:teuthology.orchestra.run.smithi167.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-11T00:41:53.499 INFO:teuthology.orchestra.run.smithi167.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-11T00:41:53.524 INFO:teuthology.orchestra.run.smithi167.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-09-11T00:41:53.549 INFO:teuthology.orchestra.run.smithi167.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-11T00:41:53.658 INFO:teuthology.orchestra.run.smithi167.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-09-11T00:41:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:41:53.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:41:53.763 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:41:53.800 INFO:teuthology.orchestra.run.smithi167.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 327 kB/s | 46 kB 00:00 2024-09-11T00:41:53.817 INFO:teuthology.orchestra.run.smithi167.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-11T00:41:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:41:53.884 INFO:teuthology.orchestra.run.smithi167.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-11T00:41:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:41:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:41:53.918 INFO:teuthology.orchestra.run.smithi167.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-11T00:41:53.943 INFO:teuthology.orchestra.run.smithi167.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-11T00:41:53.969 INFO:teuthology.orchestra.run.smithi167.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T00:41:53.994 INFO:teuthology.orchestra.run.smithi167.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T00:41:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:41:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:41:54.044 INFO:teuthology.orchestra.run.smithi167.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 720 kB/s | 90 kB 00:00 2024-09-11T00:41:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:41:54.069 INFO:teuthology.orchestra.run.smithi167.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-09-11T00:41:54.095 INFO:teuthology.orchestra.run.smithi167.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T00:41:54.120 INFO:teuthology.orchestra.run.smithi167.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-11T00:41:54.137 INFO:teuthology.orchestra.run.smithi167.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T00:41:54.162 INFO:teuthology.orchestra.run.smithi167.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T00:41:54.187 INFO:teuthology.orchestra.run.smithi167.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T00:41:54.213 INFO:teuthology.orchestra.run.smithi167.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T00:41:54.238 INFO:teuthology.orchestra.run.smithi167.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T00:41:54.272 INFO:teuthology.orchestra.run.smithi167.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-11T00:41:54.300 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:41:54.305 INFO:teuthology.orchestra.run.smithi167.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-11T00:41:54.356 INFO:teuthology.orchestra.run.smithi167.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T00:41:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:41:54.523 INFO:teuthology.orchestra.run.smithi167.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 14 MB/s | 3.5 MB 00:00 2024-09-11T00:41:54.689 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:41:54.690 INFO:teuthology.orchestra.run.smithi167.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 7.2 MB/s | 2.3 MB 00:00 2024-09-11T00:41:54.740 INFO:teuthology.orchestra.run.smithi167.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 7.5 MB/s | 3.2 MB 00:00 2024-09-11T00:41:54.782 INFO:teuthology.orchestra.run.smithi167.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 7.0 MB/s | 1.8 MB 00:00 2024-09-11T00:41:54.807 INFO:teuthology.orchestra.run.smithi167.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-11T00:41:54.829 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:41:54.924 INFO:teuthology.orchestra.run.smithi167.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-11T00:41:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:41:54.966 INFO:teuthology.orchestra.run.smithi167.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-11T00:41:55.016 INFO:teuthology.orchestra.run.smithi167.stdout:(157/157): NetworkManager-tui-1.49.90-1.el9.x86 903 kB/s | 249 kB 00:00 2024-09-11T00:41:55.022 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:41:55.022 INFO:teuthology.orchestra.run.smithi167.stdout:Total 18 MB/s | 240 MB 00:13 2024-09-11T00:41:55.227 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:41:55.381 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:41:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:41:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:41:55.546 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:41:55.601 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:41:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:41:55.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:41:55.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:41:55.872 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:41:55.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:41:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:41:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:41:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:41:56.132 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:41:56.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:41:56.204 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:41:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:41:56.349 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:41:56.439 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:41:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:41:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:41:57.095 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-11T00:41:57.276 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-11T00:41:57.277 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-11T00:41:57.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:41:57.435 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:41:57.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:41:57.515 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:41:57.554 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:41:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:41:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:41:58.090 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:41:58.222 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:41:58.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:41:58.378 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:41:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:41:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:41:58.512 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:41:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:41:58.598 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:41:58.656 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:41:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:41:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:41:58.915 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:41:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:41:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:41:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:41:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:41:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:41:59.330 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:41:59.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:41:59.539 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:41:59.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:41:59.725 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-11T00:41:59.726 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-11T00:41:59.732 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:41:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:41:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:41:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:41:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:41:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:42:00.039 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:42:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:42:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:42:00.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:42:00.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:42:01.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:42:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:42:01.698 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:42:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:42:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:42:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:42:02.024 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:42:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:42:02.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:42:02.333 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:42:02.428 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:42:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:42:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:42:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:42:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:42:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:42:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:42:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:42:05.673 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:42:05.709 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:42:05.766 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:42:06.320 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:42:06.349 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:42:06.422 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:42:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:42:06.764 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-11T00:42:06.902 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:42:06.953 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:42:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:42:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:42:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:42:07.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:42:07.556 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:42:07.678 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:42:07.824 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:42:07.881 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:42:07.984 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:42:08.021 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:42:08.059 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:42:08.289 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:42:08.351 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:42:08.377 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:42:08.503 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:42:08.545 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:42:08.627 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:42:08.654 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:42:08.713 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:42:08.931 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:42:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:09.122 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:42:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:09.311 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:42:09.434 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:42:09.544 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:42:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:09.842 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:42:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:42:09.985 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:42:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:42:10.006 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:42:10.006 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:42:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:10.019 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:42:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:42:10.080 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:42:10.161 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:42:10.233 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:42:10.288 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:42:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:42:10.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:42:10.425 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:42:10.504 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:42:10.576 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:42:10.612 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:42:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:42:10.739 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:42:10.790 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:42:10.833 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:42:10.861 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:42:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:42:11.014 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:42:11.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:42:11.299 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:42:11.368 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:42:12.016 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:42:12.119 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:42:12.456 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:42:12.508 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:42:12.546 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:42:12.609 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:42:12.817 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:42:12.907 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:42:13.021 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:42:13.101 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:42:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:42:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:42:13.345 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:42:13.386 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:42:13.431 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:42:13.482 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:42:13.654 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:42:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:42:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:42:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:42:13.907 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:42:13.949 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:42:13.980 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:42:14.004 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:42:14.163 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:42:14.326 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:42:14.375 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:42:14.412 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:42:14.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:42:14.545 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:42:14.584 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:42:14.621 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:42:14.656 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:42:14.697 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:42:14.741 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:42:14.774 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:42:14.874 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:42:14.941 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:42:14.986 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:42:15.108 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:42:15.174 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:42:16.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:42:16.168 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:42:16.204 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:42:16.320 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:42:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:42:16.440 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:42:16.563 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:42:16.614 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:42:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:42:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:42:16.985 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:42:17.806 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:42:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:42:19.531 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:42:19.640 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:42:19.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:42:19.734 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:42:20.089 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:42:20.137 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:42:20.258 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:42:20.350 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:42:20.710 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:42:21.251 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:42:21.291 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:42:21.432 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:42:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:42:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-11T00:42:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:22.955 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:42:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:42:23.005 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:23.005 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:42:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:23.965 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:24.015 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:42:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:42:24.725 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:42:24.725 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:24.725 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:42:24.725 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:42:24.726 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:42:24.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:24.735 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:42:24.872 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:42:24.872 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:42:24.872 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:42:24.872 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:24.944 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:42:24.968 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:42:25.019 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:42:25.019 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:25.019 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:42:25.019 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:42:25.019 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:42:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:42:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:42:25.561 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:25.561 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:42:25.561 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:42:25.561 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:42:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:25.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:42:25.753 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:42:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:42:26.046 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:42:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:42:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:42:26.309 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:42:26.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:42:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:42:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:42:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:42:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:42:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:42:32.316 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:42:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:42:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:42:32.560 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:42:32.560 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:32.560 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:42:32.561 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:42:32.561 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:42:32.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:42:32.644 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:42:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:42:32.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:42:33.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:42:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:42:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:42:34.037 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:34.037 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:42:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:42:34.139 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:42:34.139 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:34.140 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:42:34.140 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:42:34.140 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:42:34.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:42:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:37.782 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-11T00:42:37.783 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:37.994 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:42:38.031 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:42:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:42:38.031 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:42:39.647 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:42:39.686 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:42:39.705 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:42:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:42:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:42:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:42:39.706 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:39.730 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:42:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:42:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:42:39.956 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:42:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:42:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:42:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:42:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:42:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:42:40.113 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:42:40.153 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:42:40.197 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:42:40.499 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:42:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:42:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:42:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:42:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:42:40.550 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:40.691 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:42:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:42:40.849 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:42:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:41.077 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:42:41.086 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:41.168 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:42:41.266 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:42:41.375 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:42:41.542 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:42:41.597 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:42:41.635 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:42:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:42:42.218 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:42:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:42:42.285 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:42:42.384 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:42:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:42:42.416 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:42:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:42:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:42:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:42:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:42:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:42:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:42:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:42:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:42:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:42:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:42:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:42:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:42:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:42:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:42:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:42:43.636 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T00:42:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:46.091 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:42:46.148 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:42:47.239 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:42:47.273 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:42:47.426 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:42:47.612 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:42:47.650 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:42:47.701 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:42:47.701 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:47.701 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:42:47.701 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:42:47.702 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:42:47.702 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:47.761 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:42:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:42:47.906 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:42:47.972 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:42:49.033 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:42:49.062 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:42:49.113 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:42:49.113 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:49.113 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:42:49.114 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:42:49.114 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:42:49.114 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:49.179 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:42:49.229 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:42:49.229 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:49.230 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:42:49.230 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:49.280 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:42:49.331 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:42:49.331 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:49.331 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:42:49.331 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:42:49.331 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:42:49.332 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:49.681 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:42:49.733 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:42:49.734 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:42:49.734 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:42:49.734 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:42:49.734 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:42:49.734 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:42:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:42:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:42:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:42:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:42:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:42:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:42:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:42:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:42:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:42:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:42:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:42:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:42:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:42:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:42:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:42:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:42:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:42:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:42:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:42:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-11T00:42:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:42:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:42:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:42:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:42:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:42:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:42:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:42:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:42:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:42:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:42:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:42:52.167 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-11T00:42:52.795 DEBUG:teuthology.parallel:result is None 2024-09-11T00:42:54.854 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:42:54.903 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:42:54.948 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:42:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:42:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:42:55.272 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:42:55.334 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:42:55.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:42:55.395 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:42:55.431 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:42:56.153 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:56.204 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:56.246 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:42:57.529 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:42:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:42:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:42:57.835 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:42:57.872 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:42:57.906 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:42:57.942 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:42:57.943 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:42:58.083 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:42:58.084 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:42:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:42:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:42:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:58.461 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:42:58.461 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:42:58.579 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:42:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:42:58.932 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:42:58.932 INFO:teuthology.orchestra.run.smithi167.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T00:42:58.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:05.629 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:43:05.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:43:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:43:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:43:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:43:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:43:05.647 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:43:05.648 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:43:05.649 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:43:05.650 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:43:05.651 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:43:05.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:43:05.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:43:05.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:43:05.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:43:05.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:43:05.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:43:05.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:43:05.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:43:05.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:43:05.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.913 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.914 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.915 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:43:07.916 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:43:07.917 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:43:07.918 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:43:07.919 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:43:07.920 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:43:07.921 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:43:07.922 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:43:07.923 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:43:07.923 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:43:07.923 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:43:07.923 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:43:07.923 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:43:07.924 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:43:07.925 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:43:07.926 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:07.927 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-11T00:43:08.596 DEBUG:teuthology.parallel:result is None 2024-09-11T00:43:08.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:43:08.755 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:43:08.806 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:43:08.806 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:43:08.807 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:43:08.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:43:08.958 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:43:09.005 INFO:teuthology.orchestra.run.smithi167.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:43:09.006 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:43:09.006 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:43:09.007 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T00:43:09.008 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:09.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:43:09.068 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:09.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:43:09.128 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T00:43:09.128 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:09.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:43:09.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:43:09.279 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:09.279 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:43:09.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:43:09.454 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T00:43:09.454 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:09.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:43:09.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:43:09.603 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:09.604 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:43:09.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:43:09.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T00:43:09.762 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:09.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:43:09.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:43:09.911 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:09.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:43:10.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:43:10.137 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T00:43:10.218 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T00:43:10.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-11T00:43:10.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-11T00:43:10.278 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T00:43:10.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:43:10.282 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:43:10.338 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T00:43:10.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:43:10.342 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:43:10.407 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T00:43:10.407 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T00:43:10.407 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T00:43:10.407 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:10.407 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:43:10.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:10.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:10.672 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:10.672 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:43:10.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:10.882 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:10.967 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T00:43:10.968 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T00:43:10.968 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/ffsb}}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899851', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWUfU+JYJFZoDIXAZEtgbyRxQgACp/YKQN4KzRyXWysMDr3liyA7aX1/VhptGnfEkeXCs37rE4ooj9xBn6A+oc=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXtXo2T8S3DRwoUuIACr/0x3IgLpaqHvgoPhzS4m/yziy/cW2YhVMm+q7pPsFdVIhPJS5xGjDdMYtIYWmbjzrQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T00:43:10.969 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:43:10.972 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:43:11.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:43:11.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:43:11.104 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:11.104 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:43:11.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:43:11.139 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-11T00:43:11.214 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-11 00:42:43.963954162 +0000 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-11 00:40:37.421320712 +0000 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-11 00:40:37.421320712 +0000 2024-09-11T00:43:11.215 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-11 00:40:37.421320712 +0000 2024-09-11T00:43:11.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:43:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-11T00:43:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-11T00:43:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000448019 s, 1.1 MB/s 2024-09-11T00:43:11.310 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:43:11.347 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:11.422 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-11 00:42:43.963954162 +0000 2024-09-11T00:43:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-11 00:40:37.934310984 +0000 2024-09-11T00:43:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-11 00:40:37.934310984 +0000 2024-09-11T00:43:11.423 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-11 00:40:37.934310984 +0000 2024-09-11T00:43:11.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:43:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-11T00:43:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-11T00:43:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000288811 s, 1.8 MB/s 2024-09-11T00:43:11.517 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:43:11.553 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-11T00:43:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-11 00:42:43.964954143 +0000 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-11 00:40:38.385302433 +0000 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-11 00:40:38.385302433 +0000 2024-09-11T00:43:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-11 00:40:38.385302433 +0000 2024-09-11T00:43:11.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:43:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-11T00:43:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-11T00:43:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00026201 s, 2.0 MB/s 2024-09-11T00:43:11.726 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:43:11.763 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-11 00:42:43.965954124 +0000 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-11 00:40:38.838293842 +0000 2024-09-11T00:43:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-11 00:40:38.838293842 +0000 2024-09-11T00:43:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-11 00:40:38.838293842 +0000 2024-09-11T00:43:11.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:43:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-11T00:43:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-11T00:43:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00029976 s, 1.7 MB/s 2024-09-11T00:43:11.934 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:43:11.970 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:11.970 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:11.970 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:43:12.006 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:43:12.006 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 00:42:59.287641450 +0000 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 00:40:45.848554986 +0000 2024-09-11T00:43:12.082 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 00:40:45.848554986 +0000 2024-09-11T00:43:12.083 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 00:40:45.848554986 +0000 2024-09-11T00:43:12.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:43:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T00:43:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T00:43:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000331711 s, 1.5 MB/s 2024-09-11T00:43:12.178 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:43:12.215 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 00:42:59.288641432 +0000 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 00:40:46.311547266 +0000 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 00:40:46.311547266 +0000 2024-09-11T00:43:12.290 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 00:40:46.311547266 +0000 2024-09-11T00:43:12.291 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:43:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T00:43:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T00:43:12.383 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.0002601 s, 2.0 MB/s 2024-09-11T00:43:12.385 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:43:12.421 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-11T00:43:12.496 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 00:42:59.288641432 +0000 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 00:40:46.809538962 +0000 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 00:40:46.809538962 +0000 2024-09-11T00:43:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 00:40:46.809538962 +0000 2024-09-11T00:43:12.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:43:12.589 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T00:43:12.589 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T00:43:12.589 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000304723 s, 1.7 MB/s 2024-09-11T00:43:12.591 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:43:12.628 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-11T00:43:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:43:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:43:12.704 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-11T00:43:12.704 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:43:12.705 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:43:12.705 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 00:42:59.289641415 +0000 2024-09-11T00:43:12.705 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 00:40:47.296530841 +0000 2024-09-11T00:43:12.705 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 00:40:47.296530841 +0000 2024-09-11T00:43:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 00:40:47.296530841 +0000 2024-09-11T00:43:12.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:43:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T00:43:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T00:43:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000271823 s, 1.9 MB/s 2024-09-11T00:43:12.801 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:43:12.837 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:12.837 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:43:12.837 INFO:tasks.ceph:Generating config... 2024-09-11T00:43:12.839 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T00:43:12.839 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T00:43:12.839 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T00:43:12.839 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T00:43:12.840 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T00:43:12.841 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T00:43:12.841 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T00:43:12.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T00:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T00:43:12.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T00:43:13.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:43:13.076 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2024-09-11T00:43:13.076 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}} 2024-09-11T00:43:13.077 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:13.077 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:43:13.111 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:13.228 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:13.228 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 62a8ae86-7f85-478f-9a99-4c394aac48f1 2024-09-11T00:43:13.228 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 62a8ae86-7f85-478f-9a99-4c394aac48f1 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-11T00:43:13.227685+0000 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-11T00:43:13.227685+0000 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2024-09-11T00:43:13.229 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T00:43:13.231 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:43:13.265 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 62a8ae86-7f85-478f-9a99-4c394aac48f1... 2024-09-11T00:43:13.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:43:13.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.402 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-11T00:43:13.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:43:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 62a8ae86-7f85-478f-9a99-4c394aac48f1 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-11T00:43:13.405 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.406 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression mode = aggressive 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-11T00:43:13.407 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: filestore flush min = 0 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: osd blocked scrub grace period = 3600 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: osd max markdown count = 1000 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-11T00:43:13.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 30 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-11T00:43:13.409 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.411 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: client_shutdown_timeout = 120 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-11T00:43:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: mds oft prefetch dirfrags = True 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: mds_sleep_rank_change = 5000000.0 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-11T00:43:13.413 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-11T00:43:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-11T00:43:13.415 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.81,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-11T00:43:13.416 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 62a8ae86-7f85-478f-9a99-4c394aac48f1 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-11T00:43:13.417 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-11T00:43:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore compression mode = aggressive 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: filestore flush min = 0 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:43:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: osd blocked scrub grace period = 3600 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: osd max markdown count = 1000 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-11T00:43:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 30 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:43:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: mon down mkfs grace = 300 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T00:43:13.422 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: client_shutdown_timeout = 120 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-11T00:43:13.423 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2024-09-11T00:43:13.424 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-09-11T00:43:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: mds oft prefetch dirfrags = True 2024-09-11T00:43:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: mds_sleep_rank_change = 5000000.0 2024-09-11T00:43:13.434 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T00:43:13.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T00:43:13.531 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T00:43:13.532 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:13.532 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T00:43:13.566 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:13.566 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T00:43:13.640 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:43:13.641 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:13.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:43:13.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:43:13.758 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:13.758 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:13.833 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:43:13.833 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:13.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:43:13.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:43:13.912 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:13.912 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:13.986 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T00:43:13.988 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T00:43:13.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:43:14.098 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:43:14.209 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:43:14.215 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T00:43:14.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:43:14.318 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:43:14.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T00:43:14.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:43:14.482 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:43:14.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T00:43:14.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-11T00:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-11T00:43:14.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-11T00:43:14.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:43:14.810 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:43:14.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T00:43:14.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:43:14.975 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:43:14.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T00:43:15.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-11T00:43:15.138 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-11T00:43:15.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-11T00:43:15.199 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T00:43:15.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:43:15.281 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T00:43:15.308 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T00:43:15.308 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:43:15.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T00:43:15.364 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:15.365 INFO:tasks.ceph:role: osd.0 2024-09-11T00:43:15.365 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:43:15.365 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:43:15.426 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:15.427 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:15.814 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-11T00:43:15.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-11T00:43:15.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T00:43:15.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T00:43:16.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T00:43:16.059 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:16.059 INFO:tasks.ceph:role: osd.1 2024-09-11T00:43:16.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:43:16.059 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:43:16.121 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:16.122 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:16.479 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-11T00:43:16.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-11T00:43:16.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T00:43:16.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T00:43:16.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T00:43:16.688 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:16.688 INFO:tasks.ceph:role: osd.2 2024-09-11T00:43:16.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:43:16.688 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:16.750 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:17.130 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-11T00:43:17.134 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-11T00:43:17.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T00:43:17.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T00:43:17.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T00:43:17.352 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:17.352 INFO:tasks.ceph:role: osd.3 2024-09-11T00:43:17.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:43:17.352 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:17.415 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:17.800 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-11T00:43:17.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-11T00:43:17.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T00:43:17.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T00:43:18.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:18.112+0000 7fbeaf7a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T00:43:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:18.114+0000 7fbeaf7a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T00:43:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:18.114+0000 7fbeaf7a2640 -1 bdev(0x55d628be5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:18.114+0000 7fbeaf7a2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T00:43:21.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:43:21.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:21.256+0000 7f4904bfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T00:43:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:21.257+0000 7f4904bfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T00:43:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:21.257+0000 7f4904bfd640 -1 bdev(0x55f497b0f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:21.257+0000 7f4904bfd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T00:43:24.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:43:24.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:24.404+0000 7fe4ce4e4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T00:43:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:24.405+0000 7fe4ce4e4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T00:43:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:24.405+0000 7fe4ce4e4640 -1 bdev(0x55f64de33800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:24.405+0000 7fe4ce4e4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T00:43:27.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:43:27.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:27.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:27.566+0000 7fe617a1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T00:43:27.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:27.566+0000 7fe617a1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T00:43:27.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:27.567+0000 7fe617a1a640 -1 bdev(0x5617b6ee7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:27.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:27.567+0000 7fe617a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T00:43:30.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:43:30.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T00:43:30.933 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:30.933 INFO:tasks.ceph:role: osd.4 2024-09-11T00:43:30.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:43:30.933 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:43:30.998 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:30.998 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:30.998 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:30.998 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:30.998 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:30.999 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:30.999 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:30.999 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:30.999 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:30.999 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:31.403 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T00:43:31.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T00:43:31.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T00:43:31.536 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T00:43:31.599 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T00:43:31.655 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:31.655 INFO:tasks.ceph:role: osd.5 2024-09-11T00:43:31.655 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:43:31.655 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:43:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T00:43:32.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T00:43:32.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T00:43:32.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T00:43:32.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T00:43:32.289 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:32.290 INFO:tasks.ceph:role: osd.6 2024-09-11T00:43:32.290 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:43:32.290 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T00:43:32.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T00:43:32.745 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T00:43:32.847 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T00:43:32.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T00:43:32.967 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:43:32.967 INFO:tasks.ceph:role: osd.7 2024-09-11T00:43:32.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T00:43:32.968 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:43:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:43:33.032 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:43:33.032 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:43:33.032 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:43:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:43:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T00:43:33.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T00:43:33.425 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T00:43:33.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T00:43:33.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:33.735+0000 7ff17821e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T00:43:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:33.740+0000 7ff17821e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T00:43:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:33.740+0000 7ff17821e640 -1 bdev(0x5574db11d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:33.741+0000 7ff17821e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T00:43:36.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:43:36.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:36.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:36.925+0000 7fa263a0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T00:43:36.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:36.925+0000 7fa263a0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T00:43:36.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:36.925+0000 7fa263a0b640 -1 bdev(0x55fc75ef7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:36.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:36.925+0000 7fa263a0b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T00:43:39.951 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:43:40.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:40.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:40.097+0000 7fd199d02640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T00:43:40.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:40.097+0000 7fd199d02640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T00:43:40.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:40.097+0000 7fd199d02640 -1 bdev(0x564e6e355800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:40.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:40.098+0000 7fd199d02640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T00:43:40.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:40.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:43:43.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T00:43:43.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:43.256+0000 7f7b7460d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T00:43:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:43.256+0000 7f7b7460d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T00:43:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:43.256+0000 7f7b7460d640 -1 bdev(0x55fc8acef800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T00:43:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:43.257+0000 7f7b7460d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T00:43:46.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T00:43:46.351 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T00:43:46.351 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T00:43:46.413 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T00:43:46.511 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T00:43:46.608 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-11T00:43:46.704 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T00:43:46.800 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T00:43:46.894 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T00:43:46.990 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:46.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T00:43:47.085 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T00:43:47.141 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T00:43:47.236 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T00:43:47.332 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-11T00:43:47.427 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T00:43:47.524 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.524 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T00:43:47.619 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.619 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T00:43:47.714 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:47.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T00:43:47.809 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:47.809 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T00:43:47.846 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T00:43:47.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:43:47.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:43:47.939 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+Bm9J5uBRAANBxC+Od7TmSTRi147rts0w== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+Bmj+PpEhAA3ZOFmcF+/DwJWzRnOS7U+Q== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+BmJMOvHBAAkjZsrzCiLLtdljCoW1P5cg== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+BmYaJgJhAAuZHTIGc7rBbLzg8gPFhaVw== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCm5+Bm7lS1BhAAYGhNmpvVRtM1Ei6xSsmZ1A== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCp5+BmUoJRDxAA2zvnfzGKpT4nRwZxxfo24Q== 2024-09-11T00:43:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCs5+Bm9vglGBAAkbA5SRcN0xQx18KIqeRgqg== 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCv5+BmgovFIRAAdyOjK9HAaAcJAWF6CNT6XQ== 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+BmNaJpDBAA99jN825VXXYek3f7w4gwIg== 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+BmpJlDMBAAx0gMCalmx7PA6hUGkRF3Bg== 2024-09-11T00:43:47.941 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-11T00:43:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCi5+BmAmoZOhAAtzD/9PkIHY0kk5K2GRFE3A== 2024-09-11T00:43:47.945 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f] 2024-09-11T00:43:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCj5+Bmg1I1CBAA9cchqlzzoeHVnGuEU1Us6w== 2024-09-11T00:43:47.945 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-11T00:43:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC15+BmRIPYKxAAAjdHeXqO5B4GetCjmhHOUQ== 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC45+Bm19c2NxAAdTZe6Kf1+UdVUGGmFhmIcg== 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC85+BmxrTgBRAA91zvV8GoqaeKWoybCJhWiQ== 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC/5+Bm+DZWDxAApAKAwD9CnvKWdxq253m7AA== 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-11T00:43:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCj5+BmAPGzEBAALI0eLsuNP8g2NM5Jkh4s0g== 2024-09-11T00:43:47.948 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-09-11T00:43:47.948 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+Bm9J5uBRAANBxC+Od7TmSTRi147rts0w== 2024-09-11T00:43:47.948 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-11T00:43:47.948 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+Bmj+PpEhAA3ZOFmcF+/DwJWzRnOS7U+Q== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+BmJMOvHBAAkjZsrzCiLLtdljCoW1P5cg== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+BmYaJgJhAAuZHTIGc7rBbLzg8gPFhaVw== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCm5+Bm7lS1BhAAYGhNmpvVRtM1Ei6xSsmZ1A== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCp5+BmUoJRDxAA2zvnfzGKpT4nRwZxxfo24Q== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCs5+Bm9vglGBAAkbA5SRcN0xQx18KIqeRgqg== 2024-09-11T00:43:47.949 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCv5+BmgovFIRAAdyOjK9HAaAcJAWF6CNT6XQ== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+BmNaJpDBAA99jN825VXXYek3f7w4gwIg== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+BmpJlDMBAAx0gMCalmx7PA6hUGkRF3Bg== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCi5+BmAmoZOhAAtzD/9PkIHY0kk5K2GRFE3A== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCj5+Bmg1I1CBAA9cchqlzzoeHVnGuEU1Us6w== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC15+BmRIPYKxAAAjdHeXqO5B4GetCjmhHOUQ== 2024-09-11T00:43:47.950 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC45+Bm19c2NxAAdTZe6Kf1+UdVUGGmFhmIcg== 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC85+BmxrTgBRAA91zvV8GoqaeKWoybCJhWiQ== 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC/5+Bm+DZWDxAApAKAwD9CnvKWdxq253m7AA== 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-09-11T00:43:47.951 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCj5+BmAPGzEBAALI0eLsuNP8g2NM5Jkh4s0g== 2024-09-11T00:43:47.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:43:47.992 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:43:48.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.289 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.486 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:48.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:43:48.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:43:48.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.875 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:48.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:49.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:49.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:43:49.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.276 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:43:49.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:43:49.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:43:49.665 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T00:43:49.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T00:43:49.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:43:49.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T00:43:49.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T00:43:49.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:43:50.051 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T00:43:50.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T00:43:50.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:43:50.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T00:43:50.325 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:50.329 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:43:50.364 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T00:43:50.364 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T00:43:50.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T00:43:50.407 INFO:tasks.ceph.mon.a:Started 2024-09-11T00:43:50.408 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T00:43:50.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T00:43:50.412 INFO:tasks.ceph.mon.b:Started 2024-09-11T00:43:50.412 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T00:43:50.412 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T00:43:50.416 INFO:tasks.ceph.mon.c:Started 2024-09-11T00:43:50.416 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T00:43:50.416 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T00:43:50.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T00:43:50.420 INFO:tasks.ceph.mgr.y:Started 2024-09-11T00:43:50.420 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T00:43:50.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T00:43:50.425 INFO:tasks.ceph.mgr.x:Started 2024-09-11T00:43:50.425 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-11T00:43:50.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-11T00:43:50.429 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-11T00:43:50.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-11T00:43:50.474 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-11T00:43:50.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-11T00:43:50.520 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-11T00:43:50.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-11T00:43:50.564 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-11T00:43:50.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-11T00:43:50.612 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-11T00:43:50.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-11T00:43:50.658 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-11T00:43:50.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-11T00:43:50.706 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-11T00:43:50.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-11T00:43:50.753 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-11T00:43:50.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-09-11T00:43:50.772 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-09-11T00:43:50.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-11T00:43:50.826 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-09-11T00:43:50.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-09-11T00:43:50.865 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-09-11T00:43:50.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-11T00:43:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.872+0000 7f8fdac00640 1 -- 172.21.15.81:0/2759017443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd40cc7f0 msgr2=0x7f8fd40b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.872+0000 7f8fdac00640 1 --2- 172.21.15.81:0/2759017443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd40cc7f0 0x7f8fd40b5200 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009980 tx=0x7f8fc40046c0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 -- 172.21.15.81:0/2759017443 shutdown_connections 2024-09-11T00:43:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 --2- 172.21.15.81:0/2759017443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fd415b040 0x7f8fd414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 --2- 172.21.15.81:0/2759017443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4154b50 0x7f8fd40b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 --2- 172.21.15.81:0/2759017443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd40cc7f0 0x7f8fd40b5200 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 -- 172.21.15.81:0/2759017443 >> 172.21.15.81:0/2759017443 conn(0x7f8fd406f040 msgr2=0x7f8fd40d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 -- 172.21.15.81:0/2759017443 shutdown_connections 2024-09-11T00:43:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.873+0000 7f8fdac00640 1 -- 172.21.15.81:0/2759017443 wait complete. 2024-09-11T00:43:50.887 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-11T00:43:50.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-11T00:43:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.893+0000 7f914e200640 1 -- 172.21.15.81:0/524805219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c1c60 msgr2=0x7f914815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.905 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-11T00:43:50.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.893+0000 7f914e200640 1 --2- 172.21.15.81:0/524805219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c1c60 0x7f914815b320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9134009830 tx=0x7f913402a510 comp rx=0 tx=0).stop 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.896+0000 7f914e200640 1 -- 172.21.15.81:0/524805219 shutdown_connections 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.897+0000 7f914e200640 1 --2- 172.21.15.81:0/524805219 >> v2:172.21.15.167:3300/0 conn(0x7f91480c7100 0x7f9148153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.897+0000 7f914e200640 1 --2- 172.21.15.81:0/524805219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c1c60 0x7f914815b320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.897+0000 7f914e200640 1 -- 172.21.15.81:0/524805219 >> 172.21.15.81:0/524805219 conn(0x7f914806ff90 msgr2=0x7f91480703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.897+0000 7f914e200640 1 -- 172.21.15.81:0/524805219 shutdown_connections 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.897+0000 7f914e200640 1 -- 172.21.15.81:0/524805219 wait complete. 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.901+0000 7f914e200640 1 Processor -- start 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.901+0000 7f914e200640 1 -- start start 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.903+0000 7f914e200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.904+0000 7f9147400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.904+0000 7f9147400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:37870/0 (socket says 172.21.15.81:37870) 2024-09-11T00:43:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.904+0000 7f914e200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 0x7f91481f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.904+0000 7f9147400640 1 -- 172.21.15.81:0/1700124318 learned_addr learned my addr 172.21.15.81:0/1700124318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.905+0000 7f9146a00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 0x7f91481f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.905+0000 7f914e200640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 0x7f9148147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.906+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f914806f890 con 0x7f91480c6d20 2024-09-11T00:43:50.915 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-11T00:43:50.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.906+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9148070e90 con 0x7f91480c1c60 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.906+0000 7f9147e00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 0x7f9148147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.906+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91480c3110 con 0x7f91480c7100 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.907+0000 7f9147e00640 1 -- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 msgr2=0x7f914814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.907+0000 7f9147e00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.907+0000 7f9147e00640 1 -- 172.21.15.81:0/1700124318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 msgr2=0x7f91481f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.907+0000 7f9147e00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 0x7f91481f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.911+0000 7f9147e00640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914814de70 con 0x7f91480c7100 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.911+0000 7f9147400640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.912+0000 7f9146a00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 0x7f91481f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:43:50.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.916+0000 7f9147e00640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 0x7f9148147e00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9148071b70 tx=0x7f913800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.916+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138017070 con 0x7f91480c7100 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.916+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9138005220 con 0x7f91480c7100 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.916+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138005630 con 0x7f91480c7100 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.916+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91480cbba0 con 0x7f91480c7100 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.920+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481f89f0 con 0x7f91480c7100 2024-09-11T00:43:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.921+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f91380047a0 con 0x7f91480c7100 2024-09-11T00:43:50.927 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-11T00:43:50.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-11T00:43:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.921+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9138010610 con 0x7f91480c7100 2024-09-11T00:43:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.922+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91480c6890 con 0x7f91480c7100 2024-09-11T00:43:50.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.926+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9138004c50 con 0x7f91480c7100 2024-09-11T00:43:50.945 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = True 2024-09-11T00:43:50.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_dir_prefetch True 2024-09-11T00:43:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.950+0000 7f1768c00640 1 -- 172.21.15.81:0/1690551297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f1748005100 con 0x7f1774154b50 2024-09-11T00:43:50.966 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-11T00:43:50.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-11T00:43:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.969+0000 7f176b400640 1 -- 172.21.15.81:0/1690551297 <== mon.1 v2:172.21.15.167:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f176c005640 con 0x7f1774154b50 2024-09-11T00:43:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.969+0000 7f176b400640 1 -- 172.21.15.81:0/1690551297 <== mon.1 v2:172.21.15.167:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f176c005910 con 0x7f1774154b50 2024-09-11T00:43:50.981 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-11T00:43:50.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-11T00:43:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.967+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f91380096d0 con 0x7f91480c7100 2024-09-11T00:43:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.977+0000 7fc720a00640 1 -- 172.21.15.81:0/1753924323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc700003a30 msgr2=0x7fc700003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.977+0000 7fc720a00640 1 --2- 172.21.15.81:0/1753924323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc700003a30 0x7fc700003e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c2e0 tx=0x7fc700005830 comp rx=0 tx=0).stop 2024-09-11T00:43:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.979+0000 7fc71be00640 1 -- 172.21.15.81:0/1753924323 reap_dead start 2024-09-11T00:43:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.979+0000 7fc720a00640 1 -- 172.21.15.81:0/1753924323 shutdown_connections 2024-09-11T00:43:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.979+0000 7fc720a00640 1 -- 172.21.15.81:0/1753924323 >> 172.21.15.81:0/1753924323 conn(0x7fc71c06ffb0 msgr2=0x7fc71c070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.980+0000 7fc720a00640 1 -- 172.21.15.81:0/1753924323 shutdown_connections 2024-09-11T00:43:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.981+0000 7fc720a00640 1 -- 172.21.15.81:0/1753924323 wait complete. 2024-09-11T00:43:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.982+0000 7f177a600640 1 -- 172.21.15.81:0/1690551297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774154b50 msgr2=0x7f1774153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.982+0000 7f177a600640 1 --2- 172.21.15.81:0/1690551297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774154b50 0x7f1774153900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ea80 tx=0x7f176c00ef40 comp rx=0 tx=0).stop 2024-09-11T00:43:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.982+0000 7f177a600640 1 -- 172.21.15.81:0/1690551297 shutdown_connections 2024-09-11T00:43:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.982+0000 7f177a600640 1 --2- 172.21.15.81:0/1690551297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1774154b50 0x7f1774153900 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.993 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-11T00:43:50.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-11T00:43:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.989+0000 7f177a600640 1 --2- 172.21.15.81:0/1690551297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17740cc7f0 0x7f17741533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.989+0000 7f177a600640 1 --2- 172.21.15.81:0/1690551297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17740c5360 0x7f177414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.989+0000 7f177a600640 1 -- 172.21.15.81:0/1690551297 >> 172.21.15.81:0/1690551297 conn(0x7f177406f040 msgr2=0x7f17740c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.991+0000 7fc720a00640 1 Processor -- start 2024-09-11T00:43:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.991+0000 7fc720a00640 1 -- start start 2024-09-11T00:43:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc700003a30 0x7fc71c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 0x7fc71c1f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0723c0 con 0x7fc71c1f3cb0 2024-09-11T00:43:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c159f60 con 0x7fc700003a30 2024-09-11T00:43:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.993+0000 7fc720a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c153bd0 con 0x7fc71c168220 2024-09-11T00:43:51.014 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-11T00:43:51.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-11T00:43:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.000+0000 7f177a600640 1 -- 172.21.15.81:0/1690551297 shutdown_connections 2024-09-11T00:43:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.002+0000 7f177a600640 1 -- 172.21.15.81:0/1690551297 wait complete. 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.994+0000 7fc71be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.994+0000 7fc71be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54664/0 (socket says 172.21.15.81:54664) 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.994+0000 7fc71be00640 1 -- 172.21.15.81:0/876375025 learned_addr learned my addr 172.21.15.81:0/876375025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.994+0000 7fc71b400640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc700003a30 0x7fc71c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.995+0000 7fc71be00640 1 -- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc700003a30 msgr2=0x7fc71c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.995+0000 7fc71be00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc700003a30 0x7fc71c0c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.995+0000 7fc71be00640 1 -- 172.21.15.81:0/876375025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 msgr2=0x7fc71c1f1130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.998+0000 7fc71aa00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 0x7fc71c1f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.998+0000 7fc71be00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 0x7fc71c1f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.998+0000 7fc71be00640 1 -- 172.21.15.81:0/876375025 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c0c3540 con 0x7fc71c168220 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:50.998+0000 7fc71aa00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 0x7fc71c1f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:43:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.002+0000 7fc71be00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06de90 tx=0x7fc714004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.003+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714004830 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.003+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fc714004bf0 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.003+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714010ab0 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.004+0000 7fc720a00640 1 -- 172.21.15.81:0/876375025 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c0c63e0 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.004+0000 7fc720a00640 1 -- 172.21.15.81:0/876375025 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c0c6680 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.006+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f0005290 con 0x7fc71c168220 2024-09-11T00:43:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.010+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc71400f040 con 0x7fc71c168220 2024-09-11T00:43:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.020+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc714012680 con 0x7fc71c168220 2024-09-11T00:43:51.040 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-11T00:43:51.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-11T00:43:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.024+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc714024060 con 0x7fc71c168220 2024-09-11T00:43:51.083 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-11T00:43:51.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-11T00:43:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.084+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f9148152820 con 0x7f91480c7100 2024-09-11T00:43:51.094 DEBUG:tasks.ceph:set 23 configs 2024-09-11T00:43:51.094 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.094 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.095 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.095 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.095 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.085+0000 7fdcc4000640 1 -- 172.21.15.81:0/1894172842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb40d0ec0 msgr2=0x7fdcb40dba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.085+0000 7fdcc4000640 1 --2- 172.21.15.81:0/1894172842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb40d0ec0 0x7fdcb40dba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000b60 tx=0x7fdcbc0a6950 comp rx=0 tx=0).stop 2024-09-11T00:43:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.085+0000 7fdcc4000640 1 -- 172.21.15.81:0/1894172842 shutdown_connections 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.086+0000 7fdcc4000640 1 --2- 172.21.15.81:0/1894172842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40daca0 0x7fdcb40e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.086+0000 7fdcc4000640 1 --2- 172.21.15.81:0/1894172842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb40d0ec0 0x7fdcb40dba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.086+0000 7fdcc4000640 1 -- 172.21.15.81:0/1894172842 >> 172.21.15.81:0/1894172842 conn(0x7fdcb404fdd0 msgr2=0x7fdcb40501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.088+0000 7fdcc4000640 1 -- 172.21.15.81:0/1894172842 shutdown_connections 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.088+0000 7fdcc4000640 1 -- 172.21.15.81:0/1894172842 wait complete. 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.093+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9138009880 con 0x7f91480c7100 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.093+0000 7f913f400640 1 -- 172.21.15.81:0/1700124318 <== mon.2 v2:172.21.15.167:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f9138010810 con 0x7f91480c7100 2024-09-11T00:43:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.092+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7140129f0 con 0x7fc71c168220 2024-09-11T00:43:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.096+0000 7fdcc4000640 1 Processor -- start 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 msgr2=0x7f9148147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 0x7f9148147e00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9148071b70 tx=0x7f913800bf90 comp rx=0 tx=0).stop 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 shutdown_connections 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91480c7100 0x7f9148147e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91480c6d20 0x7f91481f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 --2- 172.21.15.81:0/1700124318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91480c1c60 0x7f914814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 >> 172.21.15.81:0/1700124318 conn(0x7f914806ff90 msgr2=0x7f914814b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.111+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 shutdown_connections 2024-09-11T00:43:51.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.111+0000 7f914e200640 1 -- 172.21.15.81:0/1700124318 wait complete. 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.099+0000 7fdcc4000640 1 -- start start 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.107+0000 7fdcc4000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb404c1d0 0x7fdcb40d6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.107+0000 7fdcc4000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 0x7fdcb40d9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.107+0000 7fdcc4000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.107+0000 7fdcc4000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb40dbfc0 con 0x7fdcb404c1d0 2024-09-11T00:43:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.108+0000 7fdcc4000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4006a40 con 0x7fdcb40daca0 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.108+0000 7fdcc4000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb40d4b50 con 0x7fdcb40d0ec0 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.109+0000 7fdcc1600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.109+0000 7fdcc1600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:37910/0 (socket says 172.21.15.81:37910) 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.109+0000 7fdcc1600640 1 -- 172.21.15.81:0/35301510 learned_addr learned my addr 172.21.15.81:0/35301510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7fdcc1600640 1 -- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 msgr2=0x7fdcb40d9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.110+0000 7fdcbbe00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 0x7fdcb40d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.112+0000 7fdcc1600640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 0x7fdcb40d9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.112+0000 7fdcc1600640 1 -- 172.21.15.81:0/35301510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb404c1d0 msgr2=0x7fdcb40d6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.112+0000 7fdcc1600640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb404c1d0 0x7fdcb40d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.112+0000 7fdcc1600640 1 -- 172.21.15.81:0/35301510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb40d7220 con 0x7fdcb40daca0 2024-09-11T00:43:51.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.112+0000 7fdcbbe00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 0x7fdcb40d9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:43:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.133+0000 7fdcc1600640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e770 tx=0x7fdca800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.133+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca800ccc0 con 0x7fdcb40daca0 2024-09-11T00:43:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.133+0000 7fdcc4000640 1 -- 172.21.15.81:0/35301510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb40d5000 con 0x7fdcb40daca0 2024-09-11T00:43:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.133+0000 7fdcc4000640 1 -- 172.21.15.81:0/35301510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb40d55c0 con 0x7fdcb40daca0 2024-09-11T00:43:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.142+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdca800ce60 con 0x7fdcb40daca0 2024-09-11T00:43:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.142+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca800ccc0 con 0x7fdcb40daca0 2024-09-11T00:43:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.151+0000 7f02e1000640 1 -- 172.21.15.81:0/1435882986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404b370 msgr2=0x7f02d404b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.145+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc90005290 con 0x7fdcb40daca0 2024-09-11T00:43:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.153+0000 7f02e1000640 1 --2- 172.21.15.81:0/1435882986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404b370 0x7f02d404b7b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02c8005fd0 tx=0x7f02c802a5f0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.155+0000 7f02e1000640 1 -- 172.21.15.81:0/1435882986 shutdown_connections 2024-09-11T00:43:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.160+0000 7f02e1000640 1 --2- 172.21.15.81:0/1435882986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404b370 0x7f02d404b7b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.160+0000 7f02e1000640 1 --2- 172.21.15.81:0/1435882986 >> v2:172.21.15.81:3300/0 conn(0x7f02d40d44d0 0x7f02d40db040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.160+0000 7f02e1000640 1 -- 172.21.15.81:0/1435882986 >> 172.21.15.81:0/1435882986 conn(0x7f02d404fdd0 msgr2=0x7f02d40501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.160+0000 7f02e1000640 1 -- 172.21.15.81:0/1435882986 shutdown_connections 2024-09-11T00:43:51.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.160+0000 7f02e1000640 1 -- 172.21.15.81:0/1435882986 wait complete. 2024-09-11T00:43:51.166 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.152+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdca80053b0 con 0x7fdcb40daca0 2024-09-11T00:43:51.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.152+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdca8021bd0 con 0x7fdcb40daca0 2024-09-11T00:43:51.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.167+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdca80047a0 con 0x7fdcb40daca0 2024-09-11T00:43:51.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.169+0000 7f02e1000640 1 Processor -- start 2024-09-11T00:43:51.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.170+0000 7f02e1000640 1 -- start start 2024-09-11T00:43:51.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404bcf0 0x7f02d40d6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 0x7f02d417bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02d40456e0 con 0x7f02d40d44d0 2024-09-11T00:43:51.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4045400 con 0x7f02d404b370 2024-09-11T00:43:51.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.171+0000 7f02e1000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f02d404c2d0 con 0x7f02d404bcf0 2024-09-11T00:43:51.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.179+0000 7f02db400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.179+0000 7f02db400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:37920/0 (socket says 172.21.15.81:37920) 2024-09-11T00:43:51.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.179+0000 7f02e2600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 0x7f02d417bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.180+0000 7f02db400640 1 -- 172.21.15.81:0/2080881144 learned_addr learned my addr 172.21.15.81:0/2080881144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.180+0000 7f02db400640 1 -- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404bcf0 msgr2=0x7f02d40d6200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:43:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.180+0000 7f02db400640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404bcf0 0x7f02d40d6200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.181+0000 7f02db400640 1 -- 172.21.15.81:0/2080881144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 msgr2=0x7f02d417bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.181+0000 7f02db400640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 0x7f02d417bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.189+0000 7f02db400640 1 -- 172.21.15.81:0/2080881144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4165580 con 0x7f02d404b370 2024-09-11T00:43:51.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.189+0000 7f02e2600640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 0x7f02d417bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:43:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.193+0000 7f02db400640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b3e0 tx=0x7f02d000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.193+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0015020 con 0x7f02d404b370 2024-09-11T00:43:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.193+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02d0011850 con 0x7f02d404b370 2024-09-11T00:43:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.193+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0011ca0 con 0x7f02d404b370 2024-09-11T00:43:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.199+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d4179510 con 0x7f02d404b370 2024-09-11T00:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.201+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f02d001a7a0 con 0x7f02d404b370 2024-09-11T00:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.203+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d404fa60 con 0x7f02d404b370 2024-09-11T00:43:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.207+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02d001acf0 con 0x7f02d404b370 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.207+0000 7fe63d600640 1 -- 172.21.15.81:0/4049862106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe638150510 msgr2=0x7fe6380c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.207+0000 7fe63d600640 1 --2- 172.21.15.81:0/4049862106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe638150510 0x7fe6380c6f00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe638075350 tx=0x7fe62402a5a0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 -- 172.21.15.81:0/4049862106 shutdown_connections 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 --2- 172.21.15.81:0/4049862106 >> v2:172.21.15.167:3300/0 conn(0x7fe638159a20 0x7fe638159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 --2- 172.21.15.81:0/4049862106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe638150510 0x7fe6380c6f00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 -- 172.21.15.81:0/4049862106 >> 172.21.15.81:0/4049862106 conn(0x7fe63806ff60 msgr2=0x7fe638070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 -- 172.21.15.81:0/4049862106 shutdown_connections 2024-09-11T00:43:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.211+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4007230 con 0x7f02d404b370 2024-09-11T00:43:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.210+0000 7fe63d600640 1 -- 172.21.15.81:0/4049862106 wait complete. 2024-09-11T00:43:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.220+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f02d0019cc0 con 0x7f02d404b370 2024-09-11T00:43:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.219+0000 7fe63d600640 1 Processor -- start 2024-09-11T00:43:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.224+0000 7fe63d600640 1 -- start start 2024-09-11T00:43:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.230+0000 7fe63d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63806d7d0 0x7fe6380c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe63d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 0x7fe6381f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe63d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe63d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6380c7710 con 0x7fe63806d7d0 2024-09-11T00:43:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe63d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6380c8130 con 0x7fe638150510 2024-09-11T00:43:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe63d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6380c7890 con 0x7fe638159a20 2024-09-11T00:43:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe636a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe636a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54728/0 (socket says 172.21.15.81:54728) 2024-09-11T00:43:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe636a00640 1 -- 172.21.15.81:0/248047198 learned_addr learned my addr 172.21.15.81:0/248047198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.232+0000 7fe636a00640 1 -- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 msgr2=0x7fe6381f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.231+0000 7fe635600640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 0x7fe6381f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.232+0000 7fe636a00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 0x7fe6381f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.232+0000 7fe636a00640 1 -- 172.21.15.81:0/248047198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63806d7d0 msgr2=0x7fe6380c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.232+0000 7fe636a00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63806d7d0 0x7fe6380c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.232+0000 7fe636a00640 1 -- 172.21.15.81:0/248047198 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe638157840 con 0x7fe638159a20 2024-09-11T00:43:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.236+0000 7fe635600640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 0x7fe6381f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:43:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.248+0000 7fe636a00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c920 tx=0x7fe62800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.250+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628007bb0 con 0x7fe638159a20 2024-09-11T00:43:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.250+0000 7fe63d600640 1 -- 172.21.15.81:0/248047198 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe638157ed0 con 0x7fe638159a20 2024-09-11T00:43:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.250+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe628007e40 con 0x7fe638159a20 2024-09-11T00:43:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.250+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628005280 con 0x7fe638159a20 2024-09-11T00:43:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.251+0000 7fe63d600640 1 -- 172.21.15.81:0/248047198 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6381f84e0 con 0x7fe638159a20 2024-09-11T00:43:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.253+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe6280047a0 con 0x7fe638159a20 2024-09-11T00:43:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.261+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe62800fd70 con 0x7fe638159a20 2024-09-11T00:43:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.285+0000 7fe63d600640 1 -- 172.21.15.81:0/248047198 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6380c6f00 con 0x7fe638159a20 2024-09-11T00:43:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.291+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe628014030 con 0x7fe638159a20 2024-09-11T00:43:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.401+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fc6f0005580 con 0x7fc71c168220 2024-09-11T00:43:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.427+0000 7fc713400640 1 -- 172.21.15.81:0/876375025 <== mon.2 v2:172.21.15.167:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fc714012ba0 con 0x7fc71c168220 2024-09-11T00:43:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 msgr2=0x7fc71c0c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06de90 tx=0x7fc714004700 comp rx=0 tx=0).stop 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 shutdown_connections 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc71c168220 0x7fc71c0c4590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c1f3cb0 0x7fc71c1f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 --2- 172.21.15.81:0/876375025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc700003a30 0x7fc71c0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.432+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 >> 172.21.15.81:0/876375025 conn(0x7fc71c06ffb0 msgr2=0x7fc71c151750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.433+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 shutdown_connections 2024-09-11T00:43:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.433+0000 7fc710c00640 1 -- 172.21.15.81:0/876375025 wait complete. 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.431+0000 7f6db1800640 1 -- 172.21.15.81:0/4108685008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d9001a9c0 msgr2=0x7f6d9001cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.435+0000 7f6daa000640 1 -- 172.21.15.81:0/4108685008 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40097d0 con 0x7f6d9001a9c0 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.435+0000 7f6db1800640 1 --2- 172.21.15.81:0/4108685008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d9001a9c0 0x7f6d9001cdb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009c00 tx=0x7f6d90005830 comp rx=0 tx=0).stop 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.435+0000 7f6db1800640 1 -- 172.21.15.81:0/4108685008 shutdown_connections 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.435+0000 7f6db1800640 1 --2- 172.21.15.81:0/4108685008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d9001a9c0 0x7f6d9001cdb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.435+0000 7f6db1800640 1 -- 172.21.15.81:0/4108685008 >> 172.21.15.81:0/4108685008 conn(0x7f6dac06ff80 msgr2=0x7f6dac070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.447+0000 7f6db1800640 1 -- 172.21.15.81:0/4108685008 shutdown_connections 2024-09-11T00:43:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.447+0000 7f6db1800640 1 -- 172.21.15.81:0/4108685008 wait complete. 2024-09-11T00:43:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.449+0000 7f6db1800640 1 Processor -- start 2024-09-11T00:43:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.455+0000 7f6db1800640 1 -- start start 2024-09-11T00:43:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.456+0000 7fba7b000640 1 -- 172.21.15.81:0/1001976550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba58004800 msgr2=0x7fba58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.456+0000 7fba7b000640 1 --2- 172.21.15.81:0/1001976550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba58004800 0x7fba58004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fba740719f0 tx=0x7fba58005830 comp rx=0 tx=0).stop 2024-09-11T00:43:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.456+0000 7fba79000640 1 -- 172.21.15.81:0/1001976550 reap_dead start 2024-09-11T00:43:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.462+0000 7f6db1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 0x7f6dac14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.463+0000 7f6db1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 0x7f6dac1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.463+0000 7f6db1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.463+0000 7f6db1800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac0c8f40 con 0x7f6d9001a9c0 2024-09-11T00:43:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.463+0000 7f6db1800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac0c8dc0 con 0x7f6dac0b18e0 2024-09-11T00:43:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.464+0000 7f6db1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6dac0c90c0 con 0x7f6dac15c0b0 2024-09-11T00:43:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.464+0000 7f4c06a00640 1 -- 172.21.15.81:0/968506177 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc031c30 con 0x7f4c000da550 2024-09-11T00:43:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.466+0000 7f4c0ee00640 1 -- 172.21.15.81:0/968506177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000da550 msgr2=0x7f4c00005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.466+0000 7f4c0ee00640 1 --2- 172.21.15.81:0/968506177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000da550 0x7f4c00005a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009860 tx=0x7f4bfc02a5a0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.470+0000 7f6daaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 0x7f6dac14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.472+0000 7fba7b000640 1 -- 172.21.15.81:0/1001976550 shutdown_connections 2024-09-11T00:43:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.472+0000 7fba7b000640 1 -- 172.21.15.81:0/1001976550 >> 172.21.15.81:0/1001976550 conn(0x7fba7406ff90 msgr2=0x7fba740703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.472+0000 7fba7b000640 1 -- 172.21.15.81:0/1001976550 shutdown_connections 2024-09-11T00:43:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7f4c0ee00640 1 -- 172.21.15.81:0/968506177 shutdown_connections 2024-09-11T00:43:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7f4c0ee00640 1 --2- 172.21.15.81:0/968506177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000da550 0x7f4c00005a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7f4c0ee00640 1 -- 172.21.15.81:0/968506177 >> 172.21.15.81:0/968506177 conn(0x7f4c0004fc20 msgr2=0x7f4c00050030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7f4c0ee00640 1 -- 172.21.15.81:0/968506177 shutdown_connections 2024-09-11T00:43:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.470+0000 7f6dab400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.470+0000 7f6dab400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54772/0 (socket says 172.21.15.81:54772) 2024-09-11T00:43:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.470+0000 7f6dab400640 1 -- 172.21.15.81:0/2529859269 learned_addr learned my addr 172.21.15.81:0/2529859269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7f4c0ee00640 1 -- 172.21.15.81:0/968506177 wait complete. 2024-09-11T00:43:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.477+0000 7f4c0ee00640 1 Processor -- start 2024-09-11T00:43:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.474+0000 7fba7b000640 1 -- 172.21.15.81:0/1001976550 wait complete. 2024-09-11T00:43:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.476+0000 7fba7b000640 1 Processor -- start 2024-09-11T00:43:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.483+0000 7f4c0ee00640 1 -- start start 2024-09-11T00:43:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.483+0000 7f6da3e00640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 0x7f6dac1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.486+0000 7f4c0ee00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 0x7f4c0016a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.489+0000 7f6da3e00640 1 -- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 msgr2=0x7f6dac14c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 0x7f4c000ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ee00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c000d4b10 con 0x7f4c0004add0 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c07400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c07e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 0x7f4c0016a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c07400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54778/0 (socket says 172.21.15.81:54778) 2024-09-11T00:43:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c07400640 1 -- 172.21.15.81:0/2928977982 learned_addr learned my addr 172.21.15.81:0/2928977982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ee00640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c00006ba0 con 0x7f4c000da550 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ee00640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0004a5a0 con 0x7f4c000d1140 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.490+0000 7f4c0ce00640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 0x7f4c000ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.492+0000 7f4c07e00640 1 -- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 msgr2=0x7f4c0004edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.492+0000 7f4c07e00640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.492+0000 7f4c07e00640 1 -- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 msgr2=0x7f4c000ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.492+0000 7f4c07e00640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 0x7f4c000ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.492+0000 7f4c07e00640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c00046ac0 con 0x7f4c0004add0 2024-09-11T00:43:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6da3e00640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6da3e00640 1 -- 172.21.15.81:0/2529859269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 msgr2=0x7f6dac14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6da3e00640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 0x7f6dac14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6da3e00640 1 -- 172.21.15.81:0/2529859269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac15be40 con 0x7f6dac0b18e0 2024-09-11T00:43:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f4c07400640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:51.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6dab400640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:51.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f6daaa00640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 0x7f6dac14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:51.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.494+0000 7fba7b000640 1 -- start start 2024-09-11T00:43:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.493+0000 7f4c0ce00640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 0x7f4c000ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.497+0000 7f4c07e00640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 0x7f4c0016a2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c080756f0 tx=0x7f4c0806df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.498+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08091070 con 0x7f4c0004add0 2024-09-11T00:43:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.498+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c08064030 con 0x7f4c0004add0 2024-09-11T00:43:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.494+0000 7f6da3e00640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 0x7f6dac1518e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06da80 tx=0x7f6d9400ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.499+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08063590 con 0x7f4c0004add0 2024-09-11T00:43:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.499+0000 7f4c0ee00640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c00046820 con 0x7f4c0004add0 2024-09-11T00:43:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.504+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4c08063730 con 0x7f4c0004add0 2024-09-11T00:43:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.504+0000 7f4c0ee00640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c00168020 con 0x7f4c0004add0 2024-09-11T00:43:51.509 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.506+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bdc005290 con 0x7f4c0004add0 2024-09-11T00:43:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.508+0000 7fba7b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.508+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94015020 con 0x7f6dac0b18e0 2024-09-11T00:43:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.508+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d94010980 con 0x7f6dac0b18e0 2024-09-11T00:43:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.508+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010db0 con 0x7f6dac0b18e0 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.508+0000 7fba7b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba7415a3a0 0x7fba741595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.510+0000 7fba7b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba740c4d80 0x7fba7414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.510+0000 7fba7b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba7406f890 con 0x7fba7415a3a0 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.510+0000 7fba7b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba74070e90 con 0x7fba58004800 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.510+0000 7fba7b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba741573f0 con 0x7fba740c4d80 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.511+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac15bb60 con 0x7f6dac0b18e0 2024-09-11T00:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.511+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac15c980 con 0x7f6dac0b18e0 2024-09-11T00:43:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.515+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4c08095bb0 con 0x7f4c0004add0 2024-09-11T00:43:51.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.515+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6d940117f0 con 0x7f6dac0b18e0 2024-09-11T00:43:51.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.515+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6d9401ac80 con 0x7f6dac0b18e0 2024-09-11T00:43:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.516+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4c08095db0 con 0x7f4c0004add0 2024-09-11T00:43:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.516+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac0c7920 con 0x7f6dac0b18e0 2024-09-11T00:43:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.518+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fdc90005850 con 0x7fdcb40daca0 2024-09-11T00:43:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.512+0000 7fba73e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.518+0000 7fba79000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba740c4d80 0x7fba7414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.518+0000 7fba73e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:37964/0 (socket says 172.21.15.81:37964) 2024-09-11T00:43:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.518+0000 7fba73e00640 1 -- 172.21.15.81:0/2349712018 learned_addr learned my addr 172.21.15.81:0/2349712018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6d9401f070 con 0x7f6dac0b18e0 2024-09-11T00:43:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7fba73e00640 1 -- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba740c4d80 msgr2=0x7fba7414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7fba73e00640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba740c4d80 0x7fba7414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7fba73e00640 1 -- 172.21.15.81:0/2349712018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba7415a3a0 msgr2=0x7fba741595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7fba73e00640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba7415a3a0 0x7fba741595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.519+0000 7fba73e00640 1 -- 172.21.15.81:0/2349712018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba74155c20 con 0x7fba58004800 2024-09-11T00:43:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.523+0000 7fba73e00640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba6400b3f0 tx=0x7fba6400b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.523+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64015020 con 0x7fba58004800 2024-09-11T00:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.523+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba64011920 con 0x7fba58004800 2024-09-11T00:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.523+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64011d70 con 0x7fba58004800 2024-09-11T00:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.523+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba74157640 con 0x7fba58004800 2024-09-11T00:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.524+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba741566c0 con 0x7fba58004800 2024-09-11T00:43:51.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.529+0000 7fdcb9600640 1 -- 172.21.15.81:0/35301510 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7fdca8004980 con 0x7fdcb40daca0 2024-09-11T00:43:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.526+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fba6401a790 con 0x7fba58004800 2024-09-11T00:43:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.526+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba64019d90 con 0x7fba58004800 2024-09-11T00:43:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 msgr2=0x7fdcb40ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e770 tx=0x7fdca800ec30 comp rx=0 tx=0).stop 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 shutdown_connections 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcb40daca0 0x7fdcb40ca9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb40d0ec0 0x7fdcb40d9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 --2- 172.21.15.81:0/35301510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb404c1d0 0x7fdcb40d6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 >> 172.21.15.81:0/35301510 conn(0x7fdcb404fdd0 msgr2=0x7fdcb40cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.533+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 shutdown_connections 2024-09-11T00:43:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.534+0000 7fdcaea00640 1 -- 172.21.15.81:0/35301510 wait complete. 2024-09-11T00:43:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.542+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c005290 con 0x7fba58004800 2024-09-11T00:43:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.548+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fba6401f020 con 0x7fba58004800 2024-09-11T00:43:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.558+0000 7fdcb4200640 1 -- 172.21.15.81:0/433691679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac159a20 msgr2=0x7fdcac159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.558+0000 7fdcb4200640 1 --2- 172.21.15.81:0/433691679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac159a20 0x7fdcac159eb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009f60 tx=0x7fdca402a7e0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.558+0000 7fdcb4200640 1 -- 172.21.15.81:0/433691679 shutdown_connections 2024-09-11T00:43:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.558+0000 7fdcb4200640 1 --2- 172.21.15.81:0/433691679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac159a20 0x7fdcac159eb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.558+0000 7fdcb4200640 1 --2- 172.21.15.81:0/433691679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac06d6d0 0x7fdcac06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.559+0000 7fdcb4200640 1 -- 172.21.15.81:0/433691679 >> 172.21.15.81:0/433691679 conn(0x7fdcac06ff60 msgr2=0x7fdcac070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.559+0000 7fdcb4200640 1 -- 172.21.15.81:0/433691679 shutdown_connections 2024-09-11T00:43:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.559+0000 7fdcb4200640 1 -- 172.21.15.81:0/433691679 wait complete. 2024-09-11T00:43:51.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.565+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f02d40d48b0 con 0x7f02d404b370 2024-09-11T00:43:51.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.563+0000 7fdcb4200640 1 Processor -- start 2024-09-11T00:43:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.566+0000 7fdcb4200640 1 -- start start 2024-09-11T00:43:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 -- 172.21.15.81:0/1468801698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0404c290 msgr2=0x7f4c0404ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 --2- 172.21.15.81:0/1468801698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0404c290 0x7f4c0404ad60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007170 tx=0x7f4c0c0a75b0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.566+0000 7ff408000640 1 -- 172.21.15.81:0/3288550669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80051c0 msgr2=0x7ff3e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.566+0000 7ff408000640 1 --2- 172.21.15.81:0/3288550669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80051c0 0x7ff3e800b9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4001740 tx=0x7ff3e8005830 comp rx=0 tx=0).stop 2024-09-11T00:43:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 -- 172.21.15.81:0/1468801698 shutdown_connections 2024-09-11T00:43:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 --2- 172.21.15.81:0/1468801698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0404c290 0x7f4c0404ad60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 --2- 172.21.15.81:0/1468801698 >> v2:172.21.15.167:3300/0 conn(0x7f4c040d4560 0x7f4c040da630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.567+0000 7f4c12000640 1 -- 172.21.15.81:0/1468801698 >> 172.21.15.81:0/1468801698 conn(0x7f4c0404fde0 msgr2=0x7f4c040501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.568+0000 7f4c12000640 1 -- 172.21.15.81:0/1468801698 shutdown_connections 2024-09-11T00:43:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.568+0000 7f4c12000640 1 -- 172.21.15.81:0/1468801698 wait complete. 2024-09-11T00:43:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.569+0000 7fdcb4200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 0x7fdcac0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.569+0000 7fdcb4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.569+0000 7fdcb1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 0x7fdcac0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.569+0000 7fdcb1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 0x7fdcac0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38022/0 (socket says 172.21.15.81:38022) 2024-09-11T00:43:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.570+0000 7ff408000640 1 -- 172.21.15.81:0/3288550669 shutdown_connections 2024-09-11T00:43:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.570+0000 7ff408000640 1 --2- 172.21.15.81:0/3288550669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80051c0 0x7ff3e800b9c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.570+0000 7ff408000640 1 -- 172.21.15.81:0/3288550669 >> 172.21.15.81:0/3288550669 conn(0x7ff400068ac0 msgr2=0x7ff40006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.570+0000 7ff408000640 1 -- 172.21.15.81:0/3288550669 shutdown_connections 2024-09-11T00:43:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.570+0000 7ff408000640 1 -- 172.21.15.81:0/3288550669 wait complete. 2024-09-11T00:43:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60310/0 (socket says 172.21.15.81:60310) 2024-09-11T00:43:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb1800640 1 -- 172.21.15.81:0/2717909889 learned_addr learned my addr 172.21.15.81:0/2717909889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb4200640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac159a20 0x7fdcac149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7f1911e00640 1 -- 172.21.15.81:0/1274218929 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8006c00 con 0x7f18f40051c0 2024-09-11T00:43:51.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7f1913400640 1 -- 172.21.15.81:0/1274218929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18f40051c0 msgr2=0x7f18f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7f1913400640 1 --2- 172.21.15.81:0/1274218929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18f40051c0 0x7f18f400b9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f18f8006fb0 tx=0x7f18f4005830 comp rx=0 tx=0).stop 2024-09-11T00:43:51.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb4200640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac06e030 con 0x7fdcac1504a0 2024-09-11T00:43:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb4200640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac0c7540 con 0x7fdcac06d6d0 2024-09-11T00:43:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb4200640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdcac150880 con 0x7fdcac159a20 2024-09-11T00:43:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.571+0000 7fdcb2c00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac159a20 0x7fdcac149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7fdcb0e00640 1 -- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac159a20 msgr2=0x7fdcac149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7fdcb0e00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac159a20 0x7fdcac149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7fdcb0e00640 1 -- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 msgr2=0x7fdcac0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7fdcb0e00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 0x7fdcac0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.577+0000 7f1910a00640 1 -- 172.21.15.81:0/1274218929 reap_dead start 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.577+0000 7f1913400640 1 -- 172.21.15.81:0/1274218929 shutdown_connections 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.577+0000 7f1913400640 1 -- 172.21.15.81:0/1274218929 >> 172.21.15.81:0/1274218929 conn(0x7f190c06ff60 msgr2=0x7f190c070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.577+0000 7f1913400640 1 -- 172.21.15.81:0/1274218929 shutdown_connections 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.577+0000 7f1913400640 1 -- 172.21.15.81:0/1274218929 wait complete. 2024-09-11T00:43:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.573+0000 7fdcb0e00640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac0b19e0 con 0x7fdcac1504a0 2024-09-11T00:43:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.575+0000 7fdcb0e00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800ab00 tx=0x7fdc98009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.578+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98029030 con 0x7fdcac1504a0 2024-09-11T00:43:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.578+0000 7f4c12000640 1 Processor -- start 2024-09-11T00:43:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.578+0000 7f4c12000640 1 -- start start 2024-09-11T00:43:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.578+0000 7f02cf400640 1 -- 172.21.15.81:0/2080881144 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f02d00193b0 con 0x7f02d404b370 2024-09-11T00:43:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.578+0000 7fdcb4200640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac1ec060 con 0x7fdcac1504a0 2024-09-11T00:43:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.579+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc98004020 con 0x7fdcac1504a0 2024-09-11T00:43:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.579+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98029030 con 0x7fdcac1504a0 2024-09-11T00:43:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 msgr2=0x7f02d404efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b3e0 tx=0x7f02d000b8a0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.579+0000 7fdcb4200640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac0c50c0 con 0x7fdcac1504a0 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 shutdown_connections 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02d40d44d0 0x7f02d417bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02d404bcf0 0x7f02d40d6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.580+0000 7f02e1000640 1 --2- 172.21.15.81:0/2080881144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02d404b370 0x7f02d404efa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.581+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 >> 172.21.15.81:0/2080881144 conn(0x7f02d404fdd0 msgr2=0x7f02d40d8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.581+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 shutdown_connections 2024-09-11T00:43:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.581+0000 7f02e1000640 1 -- 172.21.15.81:0/2080881144 wait complete. 2024-09-11T00:43:51.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.583+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdc980041d0 con 0x7fdcac1504a0 2024-09-11T00:43:51.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.583+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc9800e770 con 0x7fdcac1504a0 2024-09-11T00:43:51.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.583+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac06f830 con 0x7fdcac1504a0 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c040d4560 0x7f4c040cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c040ccf40 0x7f4c040da590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040069a0 con 0x7f4c040ccf40 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040066c0 con 0x7f4c0404c290 2024-09-11T00:43:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.586+0000 7f4c12000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c04006c80 con 0x7f4c040d4560 2024-09-11T00:43:51.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.587+0000 7f4c0aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c040d4560 0x7f4c040cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.587+0000 7f1913400640 1 Processor -- start 2024-09-11T00:43:51.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.589+0000 7f4c10a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.589+0000 7f4c10a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38030/0 (socket says 172.21.15.81:38030) 2024-09-11T00:43:51.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.589+0000 7f4c10a00640 1 -- 172.21.15.81:0/3654692190 learned_addr learned my addr 172.21.15.81:0/3654692190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.590+0000 7f4c10a00640 1 -- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c040d4560 msgr2=0x7f4c040cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.589+0000 7f1913400640 1 -- start start 2024-09-11T00:43:51.594 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.590+0000 7f4c10a00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c040d4560 0x7f4c040cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.590+0000 7f4c10a00640 1 -- 172.21.15.81:0/3654692190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c040ccf40 msgr2=0x7f4c040da590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.590+0000 7f4c10a00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c040ccf40 0x7f4c040da590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.591+0000 7f4c10a00640 1 -- 172.21.15.81:0/3654692190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c040d8310 con 0x7f4c0404c290 2024-09-11T00:43:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.591+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdc98033070 con 0x7fdcac1504a0 2024-09-11T00:43:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.594+0000 7f4c10a00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9c0 tx=0x7f4c0000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.594+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000cd80 con 0x7f4c0404c290 2024-09-11T00:43:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.594+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c00004020 con 0x7f4c0404c290 2024-09-11T00:43:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.594+0000 7f4c12000640 1 -- 172.21.15.81:0/3654692190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c040daad0 con 0x7f4c0404c290 2024-09-11T00:43:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.595+0000 7f4c12000640 1 -- 172.21.15.81:0/3654692190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c04170ca0 con 0x7f4c0404c290 2024-09-11T00:43:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.595+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00004450 con 0x7f4c0404c290 2024-09-11T00:43:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.596+0000 7f1913400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.597+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be8005290 con 0x7f4c0404c290 2024-09-11T00:43:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.596+0000 7f1913400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190c0c54a0 0x7f190c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.596+0000 7f1913400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 0x7f190c1eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.599+0000 7f190be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.597+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4c000053b0 con 0x7f4c0404c290 2024-09-11T00:43:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.597+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4c00003c50 con 0x7f4c0404c290 2024-09-11T00:43:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f190be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60344/0 (socket says 172.21.15.81:60344) 2024-09-11T00:43:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f190be00640 1 -- 172.21.15.81:0/4043377832 learned_addr learned my addr 172.21.15.81:0/4043377832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0c7080 con 0x7f190c1496f0 2024-09-11T00:43:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0c6f00 con 0x7f190c1ee5e0 2024-09-11T00:43:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f190c0c7200 con 0x7f190c0c54a0 2024-09-11T00:43:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1910a00640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 0x7f190c1eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f190b400640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190c0c54a0 0x7f190c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1910a00640 1 -- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190c0c54a0 msgr2=0x7f190c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1910a00640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190c0c54a0 0x7f190c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1910a00640 1 -- 172.21.15.81:0/4043377832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 msgr2=0x7f190c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.600+0000 7f1910a00640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7f1910a00640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c157850 con 0x7f190c1ee5e0 2024-09-11T00:43:51.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7f190be00640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:43:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7ff408000640 1 Processor -- start 2024-09-11T00:43:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7f1910a00640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 0x7f190c1eea60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001920 tx=0x7f18f802b020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7ff408000640 1 -- start start 2024-09-11T00:43:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.604+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4c000047c0 con 0x7f4c0404c290 2024-09-11T00:43:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.604+0000 7ff3f5000640 1 -- 172.21.15.81:0/162890839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80d50c0 msgr2=0x7ff3e80d5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.604+0000 7ff3f5000640 1 --2- 172.21.15.81:0/162890839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80d50c0 0x7ff3e80d5510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00757b0 tx=0x7ff3f00a6930 comp rx=0 tx=0).stop 2024-09-11T00:43:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7ff3f5000640 1 -- 172.21.15.81:0/162890839 shutdown_connections 2024-09-11T00:43:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7ff3f5000640 1 --2- 172.21.15.81:0/162890839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e80d50c0 0x7ff3e80d5510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7ff3f5000640 1 --2- 172.21.15.81:0/162890839 >> v2:172.21.15.81:3300/0 conn(0x7ff3e8005a20 0x7ff3e8032ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7ff3f5000640 1 -- 172.21.15.81:0/162890839 >> 172.21.15.81:0/162890839 conn(0x7ff3e804fc20 msgr2=0x7ff3e8050030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.606+0000 7ff3f5000640 1 -- 172.21.15.81:0/162890839 shutdown_connections 2024-09-11T00:43:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.606+0000 7ff3f5000640 1 -- 172.21.15.81:0/162890839 wait complete. 2024-09-11T00:43:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7f3557200640 1 -- 172.21.15.81:0/1428386890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580cb670 msgr2=0x7f35580cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.601+0000 7f3557200640 1 --2- 172.21.15.81:0/1428386890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580cb670 0x7f35580cba90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3548009860 tx=0x7f354802a440 comp rx=0 tx=0).stop 2024-09-11T00:43:51.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8031070 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18f80035f0 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8000e40 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c0c5e40 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c0c3710 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.605+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f18f8003a20 con 0x7f190c1ee5e0 2024-09-11T00:43:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.606+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18f8006c80 con 0x7f190c1ee5e0 2024-09-11T00:43:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.610+0000 7ff3f5000640 1 Processor -- start 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.611+0000 7ff3f5000640 1 -- start start 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 0x7ff3e81711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 0x7ff3e80cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80d50c0 0x7ff3e80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80dee50 con 0x7ff3e8005a20 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80deb70 con 0x7ff3e80d50c0 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3f5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80df130 con 0x7ff3e8046700 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3ed400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 0x7ff3e80cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3ed400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 0x7ff3e80cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54894/0 (socket says 172.21.15.81:54894) 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.613+0000 7ff3ed400640 1 -- 172.21.15.81:0/706868004 learned_addr learned my addr 172.21.15.81:0/706868004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.614+0000 7ff3ee800640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80d50c0 0x7ff3e80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.607+0000 7f3557200640 1 -- 172.21.15.81:0/1428386890 shutdown_connections 2024-09-11T00:43:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.607+0000 7f3557200640 1 --2- 172.21.15.81:0/1428386890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580cb670 0x7f35580cba90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.608+0000 7f3557200640 1 -- 172.21.15.81:0/1428386890 >> 172.21.15.81:0/1428386890 conn(0x7f355806f1e0 msgr2=0x7f355806f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.608+0000 7f3557200640 1 -- 172.21.15.81:0/1428386890 shutdown_connections 2024-09-11T00:43:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.608+0000 7f3557200640 1 -- 172.21.15.81:0/1428386890 wait complete. 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.614+0000 7ff3ede00640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 0x7ff3e81711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff3ede00640 1 -- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 msgr2=0x7ff3e80cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff3ede00640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 0x7ff3e80cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff3ede00640 1 -- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80d50c0 msgr2=0x7ff3e80cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff3ede00640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80d50c0 0x7ff3e80cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff3ede00640 1 -- 172.21.15.81:0/706868004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8171af0 con 0x7ff3e8005a20 2024-09-11T00:43:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.615+0000 7ff408000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 0x7ff4000c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.616+0000 7ff408000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 0x7ff4000cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.618+0000 7f3557200640 1 Processor -- start 2024-09-11T00:43:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.619+0000 7ff3ede00640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 0x7ff3e81711c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000d6d0 tx=0x7ff3e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.622+0000 7fc6e2600640 1 -- 172.21.15.81:0/4090656220 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4000fc0 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.621+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0017070 con 0x7ff3e8005a20 2024-09-11T00:43:51.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.622+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e0005310 con 0x7ff3e8005a20 2024-09-11T00:43:51.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.622+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0017070 con 0x7ff3e8005a20 2024-09-11T00:43:51.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff405600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 0x7ff4000c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 -- 172.21.15.81:0/4090656220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc06d7d0 msgr2=0x7fc6dc06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 --2- 172.21.15.81:0/4090656220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc06d7d0 0x7fc6dc06dbd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800d8e0 tx=0x7fc6c802c450 comp rx=0 tx=0).stop 2024-09-11T00:43:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff405600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 0x7ff4000c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38060/0 (socket says 172.21.15.81:38060) 2024-09-11T00:43:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff405600640 1 -- 172.21.15.81:0/3478631608 learned_addr learned my addr 172.21.15.81:0/3478631608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff408000640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4000cbf80 0x7ff400145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff404c00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 0x7ff4000cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 -- 172.21.15.81:0/4090656220 shutdown_connections 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 --2- 172.21.15.81:0/4090656220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc06d7d0 0x7fc6dc06dbd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 -- 172.21.15.81:0/4090656220 >> 172.21.15.81:0/4090656220 conn(0x7fc6dc06ff60 msgr2=0x7fc6dc070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7fc6e3c00640 1 -- 172.21.15.81:0/4090656220 shutdown_connections 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff408000640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000c1f50 con 0x7ff4000c5fb0 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff408000640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000c70d0 con 0x7ff3e80051c0 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff408000640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff4000c1900 con 0x7ff4000cbf80 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff404c00640 1 -- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4000cbf80 msgr2=0x7ff400145c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff404c00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4000cbf80 0x7ff400145c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff404c00640 1 -- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 msgr2=0x7ff4000c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff404c00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 0x7ff4000c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff404c00640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4000cc400 con 0x7ff4000c5fb0 2024-09-11T00:43:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7fc6e3c00640 1 -- 172.21.15.81:0/4090656220 wait complete. 2024-09-11T00:43:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e8171d90 con 0x7ff3e8005a20 2024-09-11T00:43:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.623+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e8175170 con 0x7ff3e8005a20 2024-09-11T00:43:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff3e0009820 con 0x7ff3e8005a20 2024-09-11T00:43:51.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.624+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff3e0010460 con 0x7ff3e8005a20 2024-09-11T00:43:51.629 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.627+0000 7fc6e3c00640 1 Processor -- start 2024-09-11T00:43:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.627+0000 7fc6e3c00640 1 -- start start 2024-09-11T00:43:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.627+0000 7f3557200640 1 -- start start 2024-09-11T00:43:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.628+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e8050a60 con 0x7ff3e8005a20 2024-09-11T00:43:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.628+0000 7f3420e00640 1 -- 172.21.15.81:0/422718927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c150960 msgr2=0x7f341c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.628+0000 7f3420e00640 1 --2- 172.21.15.81:0/422718927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c150960 0x7f341c0c6ab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f340c007350 tx=0x7f340c02b230 comp rx=0 tx=0).stop 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7fc6e3c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7fc6e3c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc150510 0x7fc6dc0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7fc6e3c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc159a20 0x7fc6dc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7fc6dbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6dbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38082/0 (socket says 172.21.15.81:38082) 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6dbe00640 1 -- 172.21.15.81:0/2318843050 learned_addr learned my addr 172.21.15.81:0/2318843050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6e3c00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0c7710 con 0x7fc6dc150510 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6e3c00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc06e110 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6e3c00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0c7890 con 0x7fc6dc159a20 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7fc6e1200640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc159a20 0x7fc6dc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7f3420e00640 1 -- 172.21.15.81:0/422718927 shutdown_connections 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7f3420e00640 1 --2- 172.21.15.81:0/422718927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c150960 0x7f341c0c6ab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.629+0000 7f3420e00640 1 -- 172.21.15.81:0/422718927 >> 172.21.15.81:0/422718927 conn(0x7f341c06ff90 msgr2=0x7f341c0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.628+0000 7ff404c00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 0x7ff4000cba40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec011850 tx=0x7ff3ec011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7f3557200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35580cb670 0x7f355814a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7fc6dbe00640 1 -- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc159a20 msgr2=0x7fc6dc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7fc6dbe00640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc159a20 0x7fc6dc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7fc6dbe00640 1 -- 172.21.15.81:0/2318843050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc150510 msgr2=0x7fc6dc0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7fc6dbe00640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc150510 0x7fc6dc0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.631+0000 7fc6dbe00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc158fe0 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.632+0000 7f3420e00640 1 -- 172.21.15.81:0/422718927 shutdown_connections 2024-09-11T00:43:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.632+0000 7f3420e00640 1 -- 172.21.15.81:0/422718927 wait complete. 2024-09-11T00:43:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.634+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec004460 con 0x7ff4000c5fb0 2024-09-11T00:43:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.634+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3ec016070 con 0x7ff4000c5fb0 2024-09-11T00:43:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.634+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00fb80 con 0x7ff4000c5fb0 2024-09-11T00:43:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.635+0000 7fc6dbe00640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4c0 tx=0x7fc6d000c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.630+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190c06df90 con 0x7f190c1ee5e0 2024-09-11T00:43:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff3e0004de0 con 0x7ff3e8005a20 2024-09-11T00:43:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.634+0000 7ff408000640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4000c3e90 con 0x7ff4000c5fb0 2024-09-11T00:43:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.635+0000 7ff408000640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4000cb520 con 0x7ff4000c5fb0 2024-09-11T00:43:51.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.640+0000 7f3420e00640 1 Processor -- start 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.640+0000 7f3420e00640 1 -- start start 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.641+0000 7f3420e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.641+0000 7f3420e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 0x7f341c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.641+0000 7f3420e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 0x7f341c0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.641+0000 7f3420e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f341c0725a0 con 0x7f341c150960 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f3420e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f341c0c1750 con 0x7f341c0c1c70 2024-09-11T00:43:51.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f3420e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f341c072720 con 0x7f341c070ab0 2024-09-11T00:43:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7f3419e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7f3419400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 0x7f341c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7f3419400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 0x7f341c152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38094/0 (socket says 172.21.15.81:38094) 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7f3419e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54932/0 (socket says 172.21.15.81:54932) 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff3ec00fd20 con 0x7ff4000c5fb0 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff3ec003930 con 0x7ff4000c5fb0 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.643+0000 7f3419e00640 1 -- 172.21.15.81:0/3794512918 learned_addr learned my addr 172.21.15.81:0/3794512918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f341a800640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 0x7f341c0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.632+0000 7f3557200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35580cc860 0x7f35580ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3557200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3557200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f355815e020 con 0x7f35580cc860 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3557200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f355815e670 con 0x7f35580cb670 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3557200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f355815e300 con 0x7f35581548e0 2024-09-11T00:43:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3556800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f3419e00640 1 -- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 msgr2=0x7f341c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f3419e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 0x7f341c152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f3419e00640 1 -- 172.21.15.81:0/3794512918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 msgr2=0x7f341c0c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f3419e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 0x7f341c0c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f3419e00640 1 -- 172.21.15.81:0/3794512918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c0c5a10 con 0x7f341c070ab0 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f341a800640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 0x7f341c0c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:43:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3556800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54922/0 (socket says 172.21.15.81:54922) 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3556800640 1 -- 172.21.15.81:0/1559933935 learned_addr learned my addr 172.21.15.81:0/1559933935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.636+0000 7f3555400640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35580cc860 0x7f35580ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.637+0000 7f3556800640 1 -- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35580cb670 msgr2=0x7f355814a6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.637+0000 7f3556800640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35580cb670 0x7f355814a6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.637+0000 7f3556800640 1 -- 172.21.15.81:0/1559933935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35580cc860 msgr2=0x7f35580ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.645+0000 7f3419e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f340c007470 tx=0x7f340c0035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.637+0000 7f3556800640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35580cc860 0x7f35580ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.637+0000 7f3556800640 1 -- 172.21.15.81:0/1559933935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35580ce050 con 0x7f35581548e0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.638+0000 7f3556800640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7b0 tx=0x7f355000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550017070 con 0x7f35581548e0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f3557200640 1 -- 172.21.15.81:0/1559933935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3558155120 con 0x7f35581548e0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f3557200640 1 -- 172.21.15.81:0/1559933935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35580cf960 con 0x7f35581548e0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3550005070 con 0x7f35581548e0 2024-09-11T00:43:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.642+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550017070 con 0x7f35581548e0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3550006b10 con 0x7f35581548e0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f355000aa20 con 0x7f35581548e0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.644+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4000c1be0 con 0x7ff4000c5fb0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.648+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0016020 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.648+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6d00129e0 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.648+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0012df0 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c041020 con 0x7f341c070ab0 2024-09-11T00:43:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f340c003da0 con 0x7f341c070ab0 2024-09-11T00:43:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c041020 con 0x7f341c070ab0 2024-09-11T00:43:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f18f8003d40 con 0x7f190c1ee5e0 2024-09-11T00:43:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7fc6e3c00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc1e16c0 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.649+0000 7fc6e3c00640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1e1c80 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.650+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c0c5da0 con 0x7f341c070ab0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.650+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f340c00a0d0 con 0x7f341c070ab0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.651+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c15ab10 con 0x7f341c070ab0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.651+0000 7f3557200640 1 -- 172.21.15.81:0/1559933935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3530005290 con 0x7f35581548e0 2024-09-11T00:43:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.651+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f340c046410 con 0x7f341c070ab0 2024-09-11T00:43:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.653+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc14e400 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.654+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc6d001b790 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.654+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc6d001ac50 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.654+0000 7fe63d600640 1 -- 172.21.15.81:0/248047198 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fe6380b1850 con 0x7fe638159a20 2024-09-11T00:43:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.655+0000 7fe311c00640 1 -- 172.21.15.81:0/1812024982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c0c8470 msgr2=0x7fe30c159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.655+0000 7fe311c00640 1 --2- 172.21.15.81:0/1812024982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c0c8470 0x7fe30c159c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8007350 tx=0x7fe2f802b1a0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.655+0000 7fe311c00640 1 -- 172.21.15.81:0/1812024982 shutdown_connections 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.655+0000 7fe311c00640 1 --2- 172.21.15.81:0/1812024982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c0c8470 0x7fe30c159c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.655+0000 7fe311c00640 1 --2- 172.21.15.81:0/1812024982 >> v2:172.21.15.81:3300/0 conn(0x7fe30c0c6890 0x7fe30c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.656+0000 7fe311c00640 1 -- 172.21.15.81:0/1812024982 >> 172.21.15.81:0/1812024982 conn(0x7fe30c06ff90 msgr2=0x7fe30c0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.656+0000 7fe311c00640 1 -- 172.21.15.81:0/1812024982 shutdown_connections 2024-09-11T00:43:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.656+0000 7fe311c00640 1 -- 172.21.15.81:0/1812024982 wait complete. 2024-09-11T00:43:51.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.656+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff3ec03a950 con 0x7ff4000c5fb0 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.659+0000 7fe311c00640 1 Processor -- start 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.660+0000 7fe311c00640 1 -- start start 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe30c0c6890 0x7fe30c1ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c0c8470 0x7fe30c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0c7560 con 0x7fe30c0c6890 2024-09-11T00:43:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0c7280 con 0x7fe30c0c8470 2024-09-11T00:43:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.662+0000 7fe311c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c0c7840 con 0x7fe30c150760 2024-09-11T00:43:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.659+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f355000ac70 con 0x7f35581548e0 2024-09-11T00:43:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:54952/0 (socket says 172.21.15.81:54952) 2024-09-11T00:43:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 -- 172.21.15.81:0/3374840727 learned_addr learned my addr 172.21.15.81:0/3374840727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 -- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c0c8470 msgr2=0x7fe30c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c0c8470 0x7fe30c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.666+0000 7fe30b400640 1 -- 172.21.15.81:0/3374840727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe30c0c6890 msgr2=0x7fe30c1ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.667+0000 7fe30b400640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe30c0c6890 0x7fe30c1ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.667+0000 7fe30b400640 1 -- 172.21.15.81:0/3374840727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1efac0 con 0x7fe30c150760 2024-09-11T00:43:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.667+0000 7fe30b400640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b970 tx=0x7fe30400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.668+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304019070 con 0x7fe30c150760 2024-09-11T00:43:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.668+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe30400cbf0 con 0x7fe30c150760 2024-09-11T00:43:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.668+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304014440 con 0x7fe30c150760 2024-09-11T00:43:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.669+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c0cb1f0 con 0x7fe30c150760 2024-09-11T00:43:51.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.670+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c0c5b90 con 0x7fe30c150760 2024-09-11T00:43:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.671+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe304014620 con 0x7fe30c150760 2024-09-11T00:43:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.671+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe30401d6f0 con 0x7fe30c150760 2024-09-11T00:43:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.671+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c0b19d0 con 0x7fe30c150760 2024-09-11T00:43:51.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.672+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c0c7390 con 0x7f341c070ab0 2024-09-11T00:43:51.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.674+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe304023070 con 0x7fe30c150760 2024-09-11T00:43:51.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.675+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc6dc14e400 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.681+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4bdc005850 con 0x7f4c0004add0 2024-09-11T00:43:51.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.681+0000 7fe62ea00640 1 -- 172.21.15.81:0/248047198 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) ==== 127+0+0 (secure 0 0 0) 0x7fe628004c50 con 0x7fe638159a20 2024-09-11T00:43:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 -- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 msgr2=0x7fe6381f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c920 tx=0x7fe62800cde0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 -- 172.21.15.81:0/248047198 shutdown_connections 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe638159a20 0x7fe6381f5030 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe638150510 0x7fe6381f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 --2- 172.21.15.81:0/248047198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63806d7d0 0x7fe6380c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.688+0000 7fe623e00640 1 -- 172.21.15.81:0/248047198 >> 172.21.15.81:0/248047198 conn(0x7fe63806ff60 msgr2=0x7fe6380b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.689+0000 7fe623e00640 1 -- 172.21.15.81:0/248047198 shutdown_connections 2024-09-11T00:43:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.689+0000 7f4bfbe00640 1 -- 172.21.15.81:0/2928977982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v11)=0 v11) ==== 118+0+0 (secure 0 0 0) 0x7f4c08063a50 con 0x7f4c0004add0 2024-09-11T00:43:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.689+0000 7fe623e00640 1 -- 172.21.15.81:0/248047198 wait complete. 2024-09-11T00:43:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.691+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 msgr2=0x7f4c0016a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.691+0000 7f4bf9600640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 0x7f4c0016a2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c080756f0 tx=0x7f4c0806df00 comp rx=0 tx=0).stop 2024-09-11T00:43:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 shutdown_connections 2024-09-11T00:43:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000da550 0x7f4c000ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000d1140 0x7f4c0004edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 --2- 172.21.15.81:0/2928977982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0004add0 0x7f4c0016a2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 >> 172.21.15.81:0/2928977982 conn(0x7f4c0004fc20 msgr2=0x7f4c0004c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 shutdown_connections 2024-09-11T00:43:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.695+0000 7f4bf9600640 1 -- 172.21.15.81:0/2928977982 wait complete. 2024-09-11T00:43:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 -- 172.21.15.81:0/3102609582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 msgr2=0x7f92d40c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 --2- 172.21.15.81:0/3102609582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d40c6ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92d40c9920 tx=0x7f92c402e7e0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 -- 172.21.15.81:0/3102609582 shutdown_connections 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 --2- 172.21.15.81:0/3102609582 >> v2:172.21.15.81:3300/0 conn(0x7f92d4070ab0 0x7f92d40c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 --2- 172.21.15.81:0/3102609582 >> v2:172.21.15.167:3300/0 conn(0x7f92d40c1c70 0x7f92d406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 --2- 172.21.15.81:0/3102609582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d40c6ab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.708+0000 7f92dac00640 1 -- 172.21.15.81:0/3102609582 >> 172.21.15.81:0/3102609582 conn(0x7f92d406ff90 msgr2=0x7f92d40703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.709+0000 7f92dac00640 1 -- 172.21.15.81:0/3102609582 shutdown_connections 2024-09-11T00:43:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.709+0000 7f92dac00640 1 -- 172.21.15.81:0/3102609582 wait complete. 2024-09-11T00:43:51.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.718+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f340c00a580 con 0x7f341c070ab0 2024-09-11T00:43:51.729 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.730+0000 7f92dac00640 1 Processor -- start 2024-09-11T00:43:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.730+0000 7f92dac00640 1 -- start start 2024-09-11T00:43:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.732+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fdcac0c7a40 con 0x7fdcac1504a0 2024-09-11T00:43:51.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.736+0000 7f92dac00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 0x7f92d40cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.741+0000 7f92d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 0x7f92d40cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.741+0000 7f92d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 0x7f92d40cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60436/0 (socket says 172.21.15.81:60436) 2024-09-11T00:43:51.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.741+0000 7f92d3e00640 1 -- 172.21.15.81:0/3820709604 learned_addr learned my addr 172.21.15.81:0/3820709604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.741+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 0x7f92d41ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.742+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d41436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.743+0000 7fdca9600640 1 -- 172.21.15.81:0/2717909889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fdcac0b19e0 con 0x7fdcac1504a0 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.743+0000 7f92d8c00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d41436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.743+0000 7f92cbe00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 0x7f92d41ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.747+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92d406e110 con 0x7f92d4070ab0 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.747+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40c1750 con 0x7f92d40c1c70 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.747+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92d40725a0 con 0x7f92d4150960 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 msgr2=0x7fdcac158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7fdc9ea00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800ab00 tx=0x7fdc98009dd0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.749+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 shutdown_connections 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.749+0000 7fdc9ea00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcac159a20 0x7fdcac149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.749+0000 7fdc9ea00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcac1504a0 0x7fdcac158890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.749+0000 7fdc9ea00640 1 --2- 172.21.15.81:0/2717909889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcac06d6d0 0x7fdcac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.749+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 >> 172.21.15.81:0/2717909889 conn(0x7fdcac06ff60 msgr2=0x7fdcac073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92cbe00640 1 -- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 msgr2=0x7f92d41436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92cbe00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d41436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92cbe00640 1 -- 172.21.15.81:0/3820709604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 msgr2=0x7f92d40cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92cbe00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 0x7f92d40cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92cbe00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d4146b90 con 0x7f92d40c1c70 2024-09-11T00:43:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.748+0000 7f92d8c00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d41436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.753+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 shutdown_connections 2024-09-11T00:43:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.753+0000 7fdc9ea00640 1 -- 172.21.15.81:0/2717909889 wait complete. 2024-09-11T00:43:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.756+0000 7f92cbe00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 0x7f92d41ecfc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00ea20 tx=0x7f92bc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.760+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00ccc0 con 0x7f92d40c1c70 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.760+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92bc010430 con 0x7f92d40c1c70 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.764+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d41ecae0 con 0x7f92d40c1c70 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.764+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d4146e30 con 0x7f92d40c1c70 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.769+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc010840 con 0x7f92d40c1c70 2024-09-11T00:43:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.773+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f92bc010a60 con 0x7f92d40c1c70 2024-09-11T00:43:51.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.773+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f92bc0213f0 con 0x7f92d40c1c70 2024-09-11T00:43:51.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.773+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d40ccf80 con 0x7f92d40c1c70 2024-09-11T00:43:51.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.777+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f92bc018e20 con 0x7f92d40c1c70 2024-09-11T00:43:51.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.792+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f6dac1532a0 con 0x7f6dac0b18e0 2024-09-11T00:43:51.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.806+0000 7f6da2a00640 1 -- 172.21.15.81:0/2529859269 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v13)=0 v13) ==== 116+0+0 (secure 0 0 0) 0x7f6d9401a410 con 0x7f6dac0b18e0 2024-09-11T00:43:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.810+0000 7f3557200640 1 -- 172.21.15.81:0/1559933935 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3530005580 con 0x7f35581548e0 2024-09-11T00:43:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.813+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 msgr2=0x7f6dac1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.813+0000 7f6db1800640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 0x7f6dac1518e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06da80 tx=0x7f6d9400ea20 comp rx=0 tx=0).stop 2024-09-11T00:43:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.822+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 shutdown_connections 2024-09-11T00:43:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.822+0000 7f6db1800640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dac15c0b0 0x7f6dac14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.822+0000 7f6db1800640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dac0b18e0 0x7f6dac1518e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.822+0000 7f6db1800640 1 --2- 172.21.15.81:0/2529859269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9001a9c0 0x7f6dac14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.822+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 >> 172.21.15.81:0/2529859269 conn(0x7f6dac06ff80 msgr2=0x7f6dac0c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.826+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fba4c005850 con 0x7fba58004800 2024-09-11T00:43:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.823+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 shutdown_connections 2024-09-11T00:43:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.823+0000 7f6db1800640 1 -- 172.21.15.81:0/2529859269 wait complete. 2024-09-11T00:43:51.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.829+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f4be8005850 con 0x7f4c0404c290 2024-09-11T00:43:51.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.829+0000 7f354e000640 1 -- 172.21.15.81:0/1559933935 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f35500052a0 con 0x7f35581548e0 2024-09-11T00:43:51.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.830+0000 7f3543400640 1 -- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 msgr2=0x7f35580ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.830+0000 7f3543400640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7b0 tx=0x7f355000cc70 comp rx=0 tx=0).stop 2024-09-11T00:43:51.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.832+0000 7f3543400640 1 -- 172.21.15.81:0/1559933935 shutdown_connections 2024-09-11T00:43:51.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.832+0000 7f3543400640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35581548e0 0x7f35580ce800 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.832+0000 7f3543400640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35580cc860 0x7f35580ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.832+0000 7f3543400640 1 --2- 172.21.15.81:0/1559933935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35580cb670 0x7f355814a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.832+0000 7f3543400640 1 -- 172.21.15.81:0/1559933935 >> 172.21.15.81:0/1559933935 conn(0x7f355806f1e0 msgr2=0x7f35580b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.833+0000 7f3543400640 1 -- 172.21.15.81:0/1559933935 shutdown_connections 2024-09-11T00:43:51.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.833+0000 7f3543400640 1 -- 172.21.15.81:0/1559933935 wait complete. 2024-09-11T00:43:51.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.834+0000 7fba6be00640 1 -- 172.21.15.81:0/2349712018 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7fba6401aab0 con 0x7fba58004800 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 msgr2=0x7fba740c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba6400b3f0 tx=0x7fba6400b7f0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 shutdown_connections 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba740c4d80 0x7fba7414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba7415a3a0 0x7fba741595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 --2- 172.21.15.81:0/2349712018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba58004800 0x7fba740c5c20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.842+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 >> 172.21.15.81:0/2349712018 conn(0x7fba7406ff90 msgr2=0x7fba74153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.843+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 shutdown_connections 2024-09-11T00:43:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.846+0000 7fba7b000640 1 -- 172.21.15.81:0/2349712018 wait complete. 2024-09-11T00:43:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.851+0000 7f4bff400640 1 -- 172.21.15.81:0/3654692190 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f4c000049a0 con 0x7f4c0404c290 2024-09-11T00:43:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.847+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff3e804aa40 con 0x7ff3e8005a20 2024-09-11T00:43:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 msgr2=0x7f4c040d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9c0 tx=0x7f4c0000ee80 comp rx=0 tx=0).stop 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 shutdown_connections 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c040ccf40 0x7f4c040da590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c040d4560 0x7f4c040cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 --2- 172.21.15.81:0/3654692190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0404c290 0x7f4c040d4fb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.858+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 >> 172.21.15.81:0/3654692190 conn(0x7f4c0404fde0 msgr2=0x7f4c040daeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.859+0000 7ff3e6000640 1 -- 172.21.15.81:0/706868004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7ff3e0009d30 con 0x7ff3e8005a20 2024-09-11T00:43:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.859+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 shutdown_connections 2024-09-11T00:43:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.859+0000 7f4bfcc00640 1 -- 172.21.15.81:0/3654692190 wait complete. 2024-09-11T00:43:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.861+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 msgr2=0x7ff3e81711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.861+0000 7ff3f5000640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 0x7ff3e81711c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000d6d0 tx=0x7ff3e000db90 comp rx=0 tx=0).stop 2024-09-11T00:43:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 shutdown_connections 2024-09-11T00:43:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80d50c0 0x7ff3e80cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3e8046700 0x7ff3e80cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 --2- 172.21.15.81:0/706868004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e8005a20 0x7ff3e81711c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 >> 172.21.15.81:0/706868004 conn(0x7ff3e804fc20 msgr2=0x7ff3e80062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 shutdown_connections 2024-09-11T00:43:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.863+0000 7ff3f5000640 1 -- 172.21.15.81:0/706868004 wait complete. 2024-09-11T00:43:51.893 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.893 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.893 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.891+0000 7fbd53e00640 1 -- 172.21.15.81:0/397147961 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40001620 con 0x7fbd54154b50 2024-09-11T00:43:51.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.894+0000 7fbd5c200640 1 -- 172.21.15.81:0/397147961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54154b50 msgr2=0x7fbd540d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.894+0000 7fbd5c200640 1 --2- 172.21.15.81:0/397147961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54154b50 0x7fbd540d0800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005fd0 tx=0x7fbd48032e30 comp rx=0 tx=0).stop 2024-09-11T00:43:51.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.895+0000 7fbd5c200640 1 -- 172.21.15.81:0/397147961 shutdown_connections 2024-09-11T00:43:51.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.895+0000 7fbd5c200640 1 --2- 172.21.15.81:0/397147961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54154b50 0x7fbd540d0800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.895+0000 7fbd5c200640 1 -- 172.21.15.81:0/397147961 >> 172.21.15.81:0/397147961 conn(0x7fbd5406f040 msgr2=0x7fbd5406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.895+0000 7fbd5c200640 1 -- 172.21.15.81:0/397147961 shutdown_connections 2024-09-11T00:43:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.896+0000 7fbd5c200640 1 -- 172.21.15.81:0/397147961 wait complete. 2024-09-11T00:43:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.909+0000 7fbd5c200640 1 Processor -- start 2024-09-11T00:43:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.912+0000 7fbd5c200640 1 -- start start 2024-09-11T00:43:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.915+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff4000c7720 con 0x7ff4000c5fb0 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 0x7fbd5415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 0x7fbd540ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd5415b040 0x7fbd540cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540cc0c0 con 0x7fbd54154b50 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540cb480 con 0x7fbd540cc7f0 2024-09-11T00:43:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.916+0000 7fbd5c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd540cb710 con 0x7fbd5415b040 2024-09-11T00:43:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.917+0000 7fbd59800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 0x7fbd5415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.917+0000 7fbd59800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 0x7fbd5415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:38158/0 (socket says 172.21.15.81:38158) 2024-09-11T00:43:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.917+0000 7fbd59800640 1 -- 172.21.15.81:0/970729147 learned_addr learned my addr 172.21.15.81:0/970729147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.918+0000 7fbd5a200640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd5415b040 0x7fbd540cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.918+0000 7fbd58e00640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 0x7fbd540ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.919+0000 7fbd58e00640 1 -- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd5415b040 msgr2=0x7fbd540cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.919+0000 7fbd58e00640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd5415b040 0x7fbd540cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.919+0000 7fbd58e00640 1 -- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 msgr2=0x7fbd5415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.919+0000 7fbd58e00640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 0x7fbd5415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.919+0000 7fbd58e00640 1 -- 172.21.15.81:0/970729147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd540b4320 con 0x7fbd54154b50 2024-09-11T00:43:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.920+0000 7fbd58e00640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 0x7fbd540ccf30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c7a0 tx=0x7fbd4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:51.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.921+0000 7ff3fd600640 1 -- 172.21.15.81:0/3478631608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7ff3ec028030 con 0x7ff4000c5fb0 2024-09-11T00:43:51.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 msgr2=0x7ff4000cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 0x7ff4000cba40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec011850 tx=0x7ff3ec011d10 comp rx=0 tx=0).stop 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 shutdown_connections 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4000cbf80 0x7ff400145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4000c5fb0 0x7ff4000cba40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 --2- 172.21.15.81:0/3478631608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3e80051c0 0x7ff4000c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.923+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 >> 172.21.15.81:0/3478631608 conn(0x7ff400068ac0 msgr2=0x7ff4000703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.924+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c003b70 con 0x7fbd54154b50 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.924+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd540b4ec0 con 0x7fbd54154b50 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.924+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd4c003d10 con 0x7fbd54154b50 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.924+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00aa50 con 0x7fbd54154b50 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.925+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd540b4870 con 0x7fbd54154b50 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.925+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 shutdown_connections 2024-09-11T00:43:51.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.925+0000 7ff3f2a00640 1 -- 172.21.15.81:0/3478631608 wait complete. 2024-09-11T00:43:51.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.926+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbd4c0050d0 con 0x7fbd54154b50 2024-09-11T00:43:51.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.926+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbd4c012a90 con 0x7fbd54154b50 2024-09-11T00:43:51.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.927+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd30005290 con 0x7fbd54154b50 2024-09-11T00:43:51.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.930+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f190c0b1850 con 0x7f190c1ee5e0 2024-09-11T00:43:51.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.931+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbd4c020060 con 0x7fbd54154b50 2024-09-11T00:43:51.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.932+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f341c070ee0 con 0x7f341c070ab0 2024-09-11T00:43:51.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.932+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f92d40c7390 con 0x7f92d40c1c70 2024-09-11T00:43:51.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.935+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fc6dc14e650 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.937+0000 7f1908c00640 1 -- 172.21.15.81:0/4043377832 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f18f8036a40 con 0x7f190c1ee5e0 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 msgr2=0x7f190c1eea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 0x7f190c1eea60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001920 tx=0x7f18f802b020 comp rx=0 tx=0).stop 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 shutdown_connections 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190c1ee5e0 0x7f190c1eea60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190c0c54a0 0x7f190c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 --2- 172.21.15.81:0/4043377832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190c1496f0 0x7f190c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 >> 172.21.15.81:0/4043377832 conn(0x7f190c06ff60 msgr2=0x7f190c14e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.939+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 shutdown_connections 2024-09-11T00:43:51.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.940+0000 7f1913400640 1 -- 172.21.15.81:0/4043377832 wait complete. 2024-09-11T00:43:51.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.944+0000 7f3412000640 1 -- 172.21.15.81:0/3794512918 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f340c00a580 con 0x7f341c070ab0 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.945+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 msgr2=0x7f341c14f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.945+0000 7f3420e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f340c007470 tx=0x7f340c0035f0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.945+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 shutdown_connections 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.945+0000 7f3420e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341c150960 0x7f341c0c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7f3420e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c1c70 0x7f341c152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7f3420e00640 1 --2- 172.21.15.81:0/3794512918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c070ab0 0x7f341c14f0c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 >> 172.21.15.81:0/3794512918 conn(0x7f341c06ff90 msgr2=0x7f341c14c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7fe30c0726d0 con 0x7fe30c150760 2024-09-11T00:43:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 shutdown_connections 2024-09-11T00:43:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.946+0000 7f3420e00640 1 -- 172.21.15.81:0/3794512918 wait complete. 2024-09-11T00:43:51.950 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.950 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.950 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.949+0000 7f92d0c00640 1 -- 172.21.15.81:0/3820709604 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7f92bc018e20 con 0x7f92d40c1c70 2024-09-11T00:43:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.951+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 msgr2=0x7f92d41ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.951+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 0x7f92d41ecfc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00ea20 tx=0x7f92bc00eee0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 shutdown_connections 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92d4150960 0x7f92d41436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d40c1c70 0x7f92d41ecfc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 --2- 172.21.15.81:0/3820709604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d4070ab0 0x7f92d40cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 >> 172.21.15.81:0/3820709604 conn(0x7f92d406ff90 msgr2=0x7f92d406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 shutdown_connections 2024-09-11T00:43:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.953+0000 7f92dac00640 1 -- 172.21.15.81:0/3820709604 wait complete. 2024-09-11T00:43:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.956+0000 7fc6d8c00640 1 -- 172.21.15.81:0/2318843050 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7fc6dc14e650 con 0x7fc6dc06d7d0 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.958+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 msgr2=0x7fc6dc1df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.958+0000 7fc6ce000640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4c0 tx=0x7fc6d000c980 comp rx=0 tx=0).stop 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 shutdown_connections 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6dc159a20 0x7fc6dc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc150510 0x7fc6dc0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 --2- 172.21.15.81:0/2318843050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6dc06d7d0 0x7fc6dc1df880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 >> 172.21.15.81:0/2318843050 conn(0x7fc6dc06ff60 msgr2=0x7fc6dc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 shutdown_connections 2024-09-11T00:43:51.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.959+0000 7fc6ce000640 1 -- 172.21.15.81:0/2318843050 wait complete. 2024-09-11T00:43:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.964+0000 7fe302a00640 1 -- 172.21.15.81:0/3374840727 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v23)=0 v23) ==== 117+0+0 (secure 0 0 0) 0x7fe304023070 con 0x7fe30c150760 2024-09-11T00:43:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.965+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 msgr2=0x7fe30c1487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.965+0000 7fe311c00640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b970 tx=0x7fe30400be30 comp rx=0 tx=0).stop 2024-09-11T00:43:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 shutdown_connections 2024-09-11T00:43:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe30c150760 0x7fe30c1487c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe30c0c8470 0x7fe30c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 --2- 172.21.15.81:0/3374840727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe30c0c6890 0x7fe30c1ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 >> 172.21.15.81:0/3374840727 conn(0x7fe30c06ff90 msgr2=0x7fe30c0c14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 shutdown_connections 2024-09-11T00:43:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:51.966+0000 7fe311c00640 1 -- 172.21.15.81:0/3374840727 wait complete. 2024-09-11T00:43:51.984 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'True'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-11T00:43:51.990 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-11T00:43:52.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.016+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fbd30005580 con 0x7fbd54154b50 2024-09-11T00:43:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.019+0000 7fbd51600640 1 -- 172.21.15.81:0/970729147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fbd4c012420 con 0x7fbd54154b50 2024-09-11T00:43:52.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 msgr2=0x7fbd540ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:52.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 0x7fbd540ccf30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c7a0 tx=0x7fbd4c00cc60 comp rx=0 tx=0).stop 2024-09-11T00:43:52.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 shutdown_connections 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd5415b040 0x7fbd540cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd54154b50 0x7fbd540ccf30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 --2- 172.21.15.81:0/970729147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd540cc7f0 0x7fbd5415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 >> 172.21.15.81:0/970729147 conn(0x7fbd5406f040 msgr2=0x7fbd5414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 shutdown_connections 2024-09-11T00:43:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.020+0000 7fbd5c200640 1 -- 172.21.15.81:0/970729147 wait complete. 2024-09-11T00:43:52.037 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T00:43:52.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T00:43:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.229+0000 7ff6c6600640 1 -- 172.21.15.81:0/3301985874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 msgr2=0x7ff6c015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.229+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3301985874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c015a930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009830 tx=0x7ff6a802a5c0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.229+0000 7ff6c6600640 1 -- 172.21.15.81:0/3301985874 shutdown_connections 2024-09-11T00:43:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.229+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3301985874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c015a930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.229+0000 7ff6c6600640 1 -- 172.21.15.81:0/3301985874 >> 172.21.15.81:0/3301985874 conn(0x7ff6c006f040 msgr2=0x7ff6c006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.230+0000 7ff6c6600640 1 -- 172.21.15.81:0/3301985874 shutdown_connections 2024-09-11T00:43:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.230+0000 7ff6c6600640 1 -- 172.21.15.81:0/3301985874 wait complete. 2024-09-11T00:43:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.231+0000 7ff6c6600640 1 Processor -- start 2024-09-11T00:43:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.231+0000 7ff6c6600640 1 -- start start 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6c00c5360 0x7ff6c0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c0152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c00cc0c0 con 0x7ff6c0154b50 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c00cb480 con 0x7ff6c00cc7f0 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6c6600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff6c00cb710 con 0x7ff6c00c5360 2024-09-11T00:43:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6bfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.232+0000 7ff6b7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60458/0 (socket says 172.21.15.81:60458) 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 -- 172.21.15.81:0/3497700858 learned_addr learned my addr 172.21.15.81:0/3497700858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bf400640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6c00c5360 0x7ff6c0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 -- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6c00c5360 msgr2=0x7ff6c0153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6c00c5360 0x7ff6c0153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 -- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 msgr2=0x7ff6c0152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c0152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 -- 172.21.15.81:0/3497700858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c014f490 con 0x7ff6c0154b50 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6b7e00640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6bfe00640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c770 tx=0x7ff6b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8003b70 con 0x7ff6c0154b50 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6b8003d10 con 0x7ff6c0154b50 2024-09-11T00:43:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c00b44f0 con 0x7ff6c0154b50 2024-09-11T00:43:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.233+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800aab0 con 0x7ff6c0154b50 2024-09-11T00:43:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.234+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c00b5b80 con 0x7ff6c0154b50 2024-09-11T00:43:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.234+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff6b800ac50 con 0x7ff6c0154b50 2024-09-11T00:43:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.234+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff6b8012990 con 0x7ff6c0154b50 2024-09-11T00:43:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.235+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c014f910 con 0x7ff6c0154b50 2024-09-11T00:43:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.237+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff6b80050d0 con 0x7ff6c0154b50 2024-09-11T00:43:52.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.304+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff6c00b5300 con 0x7ff6c0154b50 2024-09-11T00:43:52.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.306+0000 7ff6b7400640 1 -- 172.21.15.81:0/3497700858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff6b8012b90 con 0x7ff6c0154b50 2024-09-11T00:43:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-11T00:43:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 msgr2=0x7ff6c00b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c770 tx=0x7ff6b800cc30 comp rx=0 tx=0).stop 2024-09-11T00:43:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 shutdown_connections 2024-09-11T00:43:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6c0154b50 0x7ff6c00b4a10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c00cc7f0 0x7ff6c0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 --2- 172.21.15.81:0/3497700858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6c00c5360 0x7ff6c0153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.307+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 >> 172.21.15.81:0/3497700858 conn(0x7ff6c006f040 msgr2=0x7ff6c00c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.308+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 shutdown_connections 2024-09-11T00:43:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:52.308+0000 7ff6c6600640 1 -- 172.21.15.81:0/3497700858 wait complete. 2024-09-11T00:43:52.324 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T00:43:52.324 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T00:43:52.325 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:52.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T00:43:52.381 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:52.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T00:43:52.476 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:52.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T00:43:52.571 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:43:52.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T00:43:52.668 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:52.668 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T00:43:52.725 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:52.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T00:43:52.821 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:52.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T00:43:52.917 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T00:43:52.917 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T00:43:53.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f329a9cd-4ae9-4169-8bed-8c06aafa4763 0 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 -- 172.21.15.167:0/826554005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c154b50 msgr2=0x7fed2c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 --2- 172.21.15.167:0/826554005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c154b50 0x7fed2c0d0800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fed1c005fd0 tx=0x7fed1c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 -- 172.21.15.167:0/826554005 shutdown_connections 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 --2- 172.21.15.167:0/826554005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c154b50 0x7fed2c0d0800 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 -- 172.21.15.167:0/826554005 >> 172.21.15.167:0/826554005 conn(0x7fed2c06f040 msgr2=0x7fed2c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 -- 172.21.15.167:0/826554005 shutdown_connections 2024-09-11T00:43:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.207+0000 7fed30a00640 1 -- 172.21.15.167:0/826554005 wait complete. 2024-09-11T00:43:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.209+0000 7fed30a00640 1 Processor -- start 2024-09-11T00:43:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.209+0000 7fed30a00640 1 -- start start 2024-09-11T00:43:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 0x7fed2c148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 0x7fed2c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c15b040 0x7fed2c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0cc0c0 con 0x7fed2c154b50 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0cb480 con 0x7fed2c15b040 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed30a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c0cb710 con 0x7fed2c0cc7f0 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed29e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 0x7fed2c148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed29e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 0x7fed2c148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:52490/0 (socket says 172.21.15.167:52490) 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 0x7fed2c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed29e00640 1 -- 172.21.15.167:0/2473854177 learned_addr learned my addr 172.21.15.167:0/2473854177 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.210+0000 7fed2a800640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c15b040 0x7fed2c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 -- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 msgr2=0x7fed2c148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 0x7fed2c148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 -- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c15b040 msgr2=0x7fed2c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c15b040 0x7fed2c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 -- 172.21.15.167:0/2473854177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c150db0 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed23e00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 0x7fed2c0c61a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fed1400c3f0 tx=0x7fed1400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14017070 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed140053c0 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14003850 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c1502f0 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.211+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c0b4400 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.212+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fed140039f0 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.212+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fed1401c780 con 0x7fed2c154b50 2024-09-11T00:43:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.212+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c15e7c0 con 0x7fed2c154b50 2024-09-11T00:43:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.215+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fed14021020 con 0x7fed2c154b50 2024-09-11T00:43:53.290 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.289+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f329a9cd-4ae9-4169-8bed-8c06aafa4763", "id": 0} v 0) -- 0x7fed2c0c56f0 con 0x7fed2c154b50 2024-09-11T00:43:53.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.291+0000 7fed22000640 1 -- 172.21.15.167:0/2473854177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f329a9cd-4ae9-4169-8bed-8c06aafa4763", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fed1401c980 con 0x7fed2c154b50 2024-09-11T00:43:53.293 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-09-11T00:43:53.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 msgr2=0x7fed2c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 0x7fed2c0c61a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fed1400c3f0 tx=0x7fed1400c8b0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 shutdown_connections 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c15b040 0x7fed2c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2c154b50 0x7fed2c0c61a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 --2- 172.21.15.167:0/2473854177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed2c0cc7f0 0x7fed2c148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 >> 172.21.15.167:0/2473854177 conn(0x7fed2c06f040 msgr2=0x7fed2c158630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 shutdown_connections 2024-09-11T00:43:53.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.292+0000 7fed30a00640 1 -- 172.21.15.167:0/2473854177 wait complete. 2024-09-11T00:43:53.309 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new be080b01-709b-4d1b-b275-b96ff5040a29 1 2024-09-11T00:43:53.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 -- 172.21.15.167:0/2376853186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd0154760 msgr2=0x7fcbd015e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.467 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 --2- 172.21.15.167:0/2376853186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd0154760 0x7fcbd015e410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00cdb00 tx=0x7fcbc402a680 comp rx=0 tx=0).stop 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 -- 172.21.15.167:0/2376853186 shutdown_connections 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 --2- 172.21.15.167:0/2376853186 >> v2:172.21.15.81:3300/0 conn(0x7fcbd00cafb0 0x7fcbd00cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 --2- 172.21.15.167:0/2376853186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd0154760 0x7fcbd015e410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 -- 172.21.15.167:0/2376853186 >> 172.21.15.167:0/2376853186 conn(0x7fcbd00688e0 msgr2=0x7fcbd0068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 -- 172.21.15.167:0/2376853186 shutdown_connections 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.465+0000 7fcbd7200640 1 -- 172.21.15.167:0/2376853186 wait complete. 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.466+0000 7fcbd7200640 1 Processor -- start 2024-09-11T00:43:53.468 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 -- start start 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 0x7fcbd0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd0154760 0x7fcbd0156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd00ccc10 con 0x7fcbd0154760 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd00cc930 con 0x7fcbd00cafb0 2024-09-11T00:43:53.470 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.467+0000 7fcbd7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd0154b40 con 0x7fcbd00cff30 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54726/0 (socket says 172.21.15.167:54726) 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 0x7fcbd0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 -- 172.21.15.167:0/1850632728 learned_addr learned my addr 172.21.15.167:0/1850632728 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd6800640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd0154760 0x7fcbd0156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 -- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 msgr2=0x7fcbd0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 0x7fcbd0150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 -- 172.21.15.167:0/1850632728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd0154760 msgr2=0x7fcbd0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd0154760 0x7fcbd0156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5e00640 1 -- 172.21.15.167:0/1850632728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd01f0920 con 0x7fcbd00cafb0 2024-09-11T00:43:53.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.468+0000 7fcbd5400640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 0x7fcbd0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:53.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbd5e00640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4034040 tx=0x7fcbc4003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc403e030 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbc4003d10 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4035040 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd01f0c00 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01f11c0 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcbc4004d50 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.469+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fcbc4031400 con 0x7fcbd00cafb0 2024-09-11T00:43:53.473 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.470+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd00c60c0 con 0x7fcbd00cafb0 2024-09-11T00:43:53.474 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.472+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fcbc4005250 con 0x7fcbd00cafb0 2024-09-11T00:43:53.549 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.547+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be080b01-709b-4d1b-b275-b96ff5040a29", "id": 1} v 0) -- 0x7fcbd00b37f0 con 0x7fcbd00cafb0 2024-09-11T00:43:53.553 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.551+0000 7fcbca000640 1 -- 172.21.15.167:0/1850632728 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be080b01-709b-4d1b-b275-b96ff5040a29", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fcbc4043410 con 0x7fcbd00cafb0 2024-09-11T00:43:53.553 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 msgr2=0x7fcbd014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4034040 tx=0x7fcbc4003820 comp rx=0 tx=0).stop 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 shutdown_connections 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbd0154760 0x7fcbd0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00cff30 0x7fcbd0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.554 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 --2- 172.21.15.167:0/1850632728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00cafb0 0x7fcbd014f720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 >> 172.21.15.167:0/1850632728 conn(0x7fcbd00688e0 msgr2=0x7fcbd014aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 shutdown_connections 2024-09-11T00:43:53.555 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.552+0000 7fcbd7200640 1 -- 172.21.15.167:0/1850632728 wait complete. 2024-09-11T00:43:53.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 0caeed21-5fda-4904-b9b3-d768371118a9 2 2024-09-11T00:43:53.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.721+0000 7fb502800640 1 -- 172.21.15.167:0/2243523656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0cbea0 msgr2=0x7fb4fc15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.721+0000 7fb502800640 1 --2- 172.21.15.167:0/2243523656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0cbea0 0x7fb4fc15af40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0caee0 tx=0x7fb4e802a520 comp rx=0 tx=0).stop 2024-09-11T00:43:53.724 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 -- 172.21.15.167:0/2243523656 shutdown_connections 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 --2- 172.21.15.167:0/2243523656 >> v2:172.21.15.167:3300/0 conn(0x7fb4fc0c4f40 0x7fb4fc15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 --2- 172.21.15.167:0/2243523656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0cbea0 0x7fb4fc15af40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 -- 172.21.15.167:0/2243523656 >> 172.21.15.167:0/2243523656 conn(0x7fb4fc0688e0 msgr2=0x7fb4fc068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 -- 172.21.15.167:0/2243523656 shutdown_connections 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.722+0000 7fb502800640 1 -- 172.21.15.167:0/2243523656 wait complete. 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.723+0000 7fb502800640 1 Processor -- start 2024-09-11T00:43:53.725 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.723+0000 7fb502800640 1 -- start start 2024-09-11T00:43:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 0x7fb4fc156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4fc0cbea0 0x7fb4fc150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc0cb290 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc15e0e0 con 0x7fb4fc1547f0 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb502800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb4fc15dd70 con 0x7fb4fc0cbea0 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.724+0000 7fb501e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb500a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4fc0cbea0 0x7fb4fc150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54744/0 (socket says 172.21.15.167:54744) 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501e00640 1 -- 172.21.15.167:0/3553702404 learned_addr learned my addr 172.21.15.167:0/3553702404 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 0x7fb4fc156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 -- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4fc0cbea0 msgr2=0x7fb4fc150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4fc0cbea0 0x7fb4fc150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 -- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 msgr2=0x7fb4fc150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 -- 172.21.15.167:0/3553702404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc0b53c0 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501e00640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.725+0000 7fb501400640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 0x7fb4fc156740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c3c0 tx=0x7fb4f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011790 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4f0017070 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011cc0 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4fc0b56a0 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4fc0b5c60 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb4f001c460 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.726+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb4f0011e60 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.727+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4fc0cb5b0 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.731 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.729+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb4f001c780 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.817+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0caeed21-5fda-4904-b9b3-d768371118a9", "id": 2} v 0) -- 0x7fb4fc0c6890 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.819+0000 7fb4f9600640 1 -- 172.21.15.167:0/3553702404 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0caeed21-5fda-4904-b9b3-d768371118a9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb4f001ca40 con 0x7fb4fc0c4f40 2024-09-11T00:43:53.821 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-09-11T00:43:53.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 msgr2=0x7fb4fc156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 0x7fb4fc156740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c3c0 tx=0x7fb4f000c880 comp rx=0 tx=0).stop 2024-09-11T00:43:53.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 shutdown_connections 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4fc1547f0 0x7fb4fc150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4fc0cbea0 0x7fb4fc150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 --2- 172.21.15.167:0/3553702404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc0c4f40 0x7fb4fc156740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 >> 172.21.15.167:0/3553702404 conn(0x7fb4fc0688e0 msgr2=0x7fb4fc06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 shutdown_connections 2024-09-11T00:43:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.821+0000 7fb502800640 1 -- 172.21.15.167:0/3553702404 wait complete. 2024-09-11T00:43:53.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 70834bf0-d46b-4e78-bac3-e78285ecb3ba 3 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 -- 172.21.15.167:0/1696185423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 msgr2=0x7f7f6c15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 --2- 172.21.15.167:0/1696185423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c15af40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009860 tx=0x7f7f5802a5a0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 -- 172.21.15.167:0/1696185423 shutdown_connections 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 --2- 172.21.15.167:0/1696185423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c15af40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 -- 172.21.15.167:0/1696185423 >> 172.21.15.167:0/1696185423 conn(0x7f7f6c0688e0 msgr2=0x7f7f6c068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 -- 172.21.15.167:0/1696185423 shutdown_connections 2024-09-11T00:43:53.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.994+0000 7f7f72800640 1 -- 172.21.15.167:0/1696185423 wait complete. 2024-09-11T00:43:53.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.996+0000 7f7f72800640 1 Processor -- start 2024-09-11T00:43:53.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.996+0000 7f7f72800640 1 -- start start 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f6c0c4f40 0x7f7f6c1e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c1547f0 0x7f7f6c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c15e0e0 con 0x7f7f6c1547f0 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0cad60 con 0x7f7f6c0c4f40 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f72800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c15dd70 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f70a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f71400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f6c0c4f40 0x7f7f6c1e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f70a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:52538/0 (socket says 172.21.15.167:52538) 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f70a00640 1 -- 172.21.15.167:0/2776327863 learned_addr learned my addr 172.21.15.167:0/2776327863 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:54.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.997+0000 7f7f71e00640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c1547f0 0x7f7f6c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 -- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f6c0c4f40 msgr2=0x7f7f6c1e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f6c0c4f40 0x7f7f6c1e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 -- 172.21.15.167:0/2776327863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c1547f0 msgr2=0x7f7f6c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c1547f0 0x7f7f6c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 -- 172.21.15.167:0/2776327863 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c0cf830 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f70a00640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802ab90 tx=0x7f7f58032c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58040070 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f58032e70 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f580055b0 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c150230 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.998+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1507d0 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.999+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7f58003b90 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.999+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7f58004c30 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:53.999+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c15af40 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.002+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7f580047a0 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.075+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70834bf0-d46b-4e78-bac3-e78285ecb3ba", "id": 3} v 0) -- 0x7f7f6c14ffc0 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.082 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.080+0000 7f7f69600640 1 -- 172.21.15.167:0/2776327863 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70834bf0-d46b-4e78-bac3-e78285ecb3ba", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7f58004a40 con 0x7f7f6c0cbea0 2024-09-11T00:43:54.082 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 msgr2=0x7f7f6c1f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f5802ab90 tx=0x7f7f58032c80 comp rx=0 tx=0).stop 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 shutdown_connections 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c1547f0 0x7f7f6c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f6c0cbea0 0x7f7f6c1f4330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 --2- 172.21.15.167:0/2776327863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f6c0c4f40 0x7f7f6c1e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 >> 172.21.15.167:0/2776327863 conn(0x7f7f6c0688e0 msgr2=0x7f7f6c159510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 shutdown_connections 2024-09-11T00:43:54.084 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.081+0000 7f7f72800640 1 -- 172.21.15.167:0/2776327863 wait complete. 2024-09-11T00:43:54.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 54abce3f-8da0-456b-aaba-f49e981ca568 4 2024-09-11T00:43:54.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 -- 172.21.15.167:0/4050168107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cafb0 msgr2=0x7f7cac15e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/4050168107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cafb0 0x7f7cac15e410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009830 tx=0x7f7c9802a640 comp rx=0 tx=0).stop 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 -- 172.21.15.167:0/4050168107 shutdown_connections 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/4050168107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cafb0 0x7f7cac15e410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 -- 172.21.15.167:0/4050168107 >> 172.21.15.167:0/4050168107 conn(0x7f7cac0688e0 msgr2=0x7f7cac068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 -- 172.21.15.167:0/4050168107 shutdown_connections 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.249+0000 7f7cb1e00640 1 -- 172.21.15.167:0/4050168107 wait complete. 2024-09-11T00:43:54.252 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.251+0000 7f7cb1e00640 1 Processor -- start 2024-09-11T00:43:54.253 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.251+0000 7f7cb1e00640 1 -- start start 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.251+0000 7f7cb1e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cff30 0x7f7cac1f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cac154760 0x7f7cac0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac0cc930 con 0x7f7cac0cff30 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac0cc650 con 0x7f7cac154760 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac0ccc10 con 0x7f7cac0cafb0 2024-09-11T00:43:54.255 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb1400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cac154760 0x7f7cac0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:52542/0 (socket says 172.21.15.167:52542) 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cff30 0x7f7cac1f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 -- 172.21.15.167:0/2982726448 learned_addr learned my addr 172.21.15.167:0/2982726448 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 -- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cac154760 msgr2=0x7f7cac0b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cac154760 0x7f7cac0b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 -- 172.21.15.167:0/2982726448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cff30 msgr2=0x7f7cac1f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cff30 0x7f7cac1f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.252+0000 7f7cb0a00640 1 -- 172.21.15.167:0/2982726448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0b41e0 con 0x7f7cac0cafb0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7cb0a00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c4c0 tx=0x7f7ca000c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0016020 con 0x7f7cac0cafb0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca0012940 con 0x7f7cac0cafb0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac1f1830 con 0x7f7cac0cafb0 2024-09-11T00:43:54.256 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0012d90 con 0x7f7cac0cafb0 2024-09-11T00:43:54.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac155050 con 0x7f7cac0cafb0 2024-09-11T00:43:54.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7ca001b790 con 0x7f7cac0cafb0 2024-09-11T00:43:54.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.253+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7ca001a3b0 con 0x7f7cac0cafb0 2024-09-11T00:43:54.257 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.254+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac0c60c0 con 0x7f7cac0cafb0 2024-09-11T00:43:54.258 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.257+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7ca0020030 con 0x7f7cac0cafb0 2024-09-11T00:43:54.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.331+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "54abce3f-8da0-456b-aaba-f49e981ca568", "id": 4} v 0) -- 0x7f7cac0b37f0 con 0x7f7cac0cafb0 2024-09-11T00:43:54.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.335+0000 7f7ca8c00640 1 -- 172.21.15.167:0/2982726448 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54abce3f-8da0-456b-aaba-f49e981ca568", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7cac0b41e0 con 0x7f7cac0cafb0 2024-09-11T00:43:54.337 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 msgr2=0x7f7cac156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c4c0 tx=0x7f7ca000c980 comp rx=0 tx=0).stop 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 shutdown_connections 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cac154760 0x7f7cac0b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac0cff30 0x7f7cac1f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 --2- 172.21.15.167:0/2982726448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cac0cafb0 0x7f7cac156d80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 >> 172.21.15.167:0/2982726448 conn(0x7f7cac0688e0 msgr2=0x7f7cac0d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 shutdown_connections 2024-09-11T00:43:54.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.337+0000 7f7cb1e00640 1 -- 172.21.15.167:0/2982726448 wait complete. 2024-09-11T00:43:54.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new da42f801-5ca2-4720-a59f-1031fc65f7ec 5 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.506+0000 7f61fe800640 1 -- 172.21.15.167:0/3712879129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 msgr2=0x7f61f815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.506+0000 7f61fe800640 1 --2- 172.21.15.167:0/3712879129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f815bfd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61f8072530 tx=0x7f61f002aac0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 -- 172.21.15.167:0/3712879129 shutdown_connections 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 --2- 172.21.15.167:0/3712879129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f815bfd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 --2- 172.21.15.167:0/3712879129 >> v2:172.21.15.81:3300/0 conn(0x7f61f8070ab0 0x7f61f815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 -- 172.21.15.167:0/3712879129 >> 172.21.15.167:0/3712879129 conn(0x7f61f806ff90 msgr2=0x7f61f80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 -- 172.21.15.167:0/3712879129 shutdown_connections 2024-09-11T00:43:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.507+0000 7f61fe800640 1 -- 172.21.15.167:0/3712879129 wait complete. 2024-09-11T00:43:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.508+0000 7f61fe800640 1 Processor -- start 2024-09-11T00:43:54.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.508+0000 7f61fe800640 1 -- start start 2024-09-11T00:43:54.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f81f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8158950 con 0x7f61f8070ab0 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8074d30 con 0x7f61f8159150 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.509+0000 7f61fe800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f61f80ccce0 con 0x7f61f8152780 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f81f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61efe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.167:58944/0 (socket says 172.21.15.167:58944) 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61efe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:52554/0 (socket says 172.21.15.167:52554) 2024-09-11T00:43:54.512 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 -- 172.21.15.167:0/585067688 learned_addr learned my addr 172.21.15.167:0/585067688 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 -- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 msgr2=0x7f61f8151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 -- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 msgr2=0x7f61f81f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f81f0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 -- 172.21.15.167:0/585067688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f80b05f0 con 0x7f61f8070ab0 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61efe00640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7e00640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f81f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:54.514 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.510+0000 7f61f7400640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c420 tx=0x7f61e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e80052d0 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e8007020 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f80ae8c0 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8007470 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f80aeb40 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f61e80067d0 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.511+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f61e8007610 con 0x7f61f8070ab0 2024-09-11T00:43:54.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.512+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f80c6300 con 0x7f61f8070ab0 2024-09-11T00:43:54.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.514+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f61f80ae8c0 con 0x7f61f8070ab0 2024-09-11T00:43:54.591 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.589+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da42f801-5ca2-4720-a59f-1031fc65f7ec", "id": 5} v 0) -- 0x7f61f80c5ed0 con 0x7f61f8070ab0 2024-09-11T00:43:54.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.591+0000 7f61ef400640 1 -- 172.21.15.167:0/585067688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da42f801-5ca2-4720-a59f-1031fc65f7ec", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f61f8074ab0 con 0x7f61f8070ab0 2024-09-11T00:43:54.593 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.592+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 msgr2=0x7f61f80c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.592+0000 7f61fe800640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c420 tx=0x7f61e800c8e0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.592+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 shutdown_connections 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8159150 0x7f61f81f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8152780 0x7f61f8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 --2- 172.21.15.167:0/585067688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f8070ab0 0x7f61f80c2960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 >> 172.21.15.167:0/585067688 conn(0x7f61f806ff90 msgr2=0x7f61f8072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 shutdown_connections 2024-09-11T00:43:54.595 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.593+0000 7f61fe800640 1 -- 172.21.15.167:0/585067688 wait complete. 2024-09-11T00:43:54.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 679373c5-4b0b-4ca9-9808-29966ab5f724 6 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 -- 172.21.15.167:0/3746514051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40cbea0 msgr2=0x7f7cc415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 --2- 172.21.15.167:0/3746514051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40cbea0 0x7f7cc415e570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40caee0 tx=0x7f7cac02a5f0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 -- 172.21.15.167:0/3746514051 shutdown_connections 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 --2- 172.21.15.167:0/3746514051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40cbea0 0x7f7cc415e570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 --2- 172.21.15.167:0/3746514051 >> v2:172.21.15.81:3300/0 conn(0x7f7cc41547f0 0x7f7cc415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 -- 172.21.15.167:0/3746514051 >> 172.21.15.167:0/3746514051 conn(0x7f7cc40688e0 msgr2=0x7f7cc4068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 -- 172.21.15.167:0/3746514051 shutdown_connections 2024-09-11T00:43:54.764 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.761+0000 7f7cc3200640 1 -- 172.21.15.167:0/3746514051 wait complete. 2024-09-11T00:43:54.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.763+0000 7f7cc3200640 1 Processor -- start 2024-09-11T00:43:54.765 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.763+0000 7f7cc3200640 1 -- start start 2024-09-11T00:43:54.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.767 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 0x7f7cc4155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc41547f0 0x7f7cc414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc40cb290 con 0x7f7cc41547f0 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc415e0e0 con 0x7f7cc40c4f40 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc415dd70 con 0x7f7cc40cbea0 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc1e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cbbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 0x7f7cc4155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc1e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54798/0 (socket says 172.21.15.167:54798) 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc1e00640 1 -- 172.21.15.167:0/1126116802 learned_addr learned my addr 172.21.15.167:0/1126116802 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.764+0000 7f7cc2800640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc41547f0 0x7f7cc414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 -- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 msgr2=0x7f7cc4155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 0x7f7cc4155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 -- 172.21.15.167:0/1126116802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc41547f0 msgr2=0x7f7cc414fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc41547f0 0x7f7cc414fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 -- 172.21.15.167:0/1126116802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc41f3ab0 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cbbe00640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 0x7f7cc4155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc1e00640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400e9f0 tx=0x7f7cb400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400cd80 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cb4004020 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc415bf40 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4004470 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.765+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc4152b90 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.766+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7cb4003980 con 0x7f7cc40c4f40 2024-09-11T00:43:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.766+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7cb4009490 con 0x7f7cc40c4f40 2024-09-11T00:43:54.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.766+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc40cb5b0 con 0x7f7cc40c4f40 2024-09-11T00:43:54.770 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.769+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7cb4003d00 con 0x7f7cc40c4f40 2024-09-11T00:43:54.845 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.843+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "679373c5-4b0b-4ca9-9808-29966ab5f724", "id": 6} v 0) -- 0x7f7cc4153b60 con 0x7f7cc40c4f40 2024-09-11T00:43:54.849 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.847+0000 7f7cba000640 1 -- 172.21.15.167:0/1126116802 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "679373c5-4b0b-4ca9-9808-29966ab5f724", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7cb4018cd0 con 0x7f7cc40c4f40 2024-09-11T00:43:54.849 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 msgr2=0x7f7cc414d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400e9f0 tx=0x7f7cb400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 shutdown_connections 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cc41547f0 0x7f7cc414fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cc40cbea0 0x7f7cc4155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 --2- 172.21.15.167:0/1126116802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc40c4f40 0x7f7cc414d9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:54.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 >> 172.21.15.167:0/1126116802 conn(0x7f7cc40688e0 msgr2=0x7f7cc40c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:54.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 shutdown_connections 2024-09-11T00:43:54.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:54.848+0000 7f7cc3200640 1 -- 172.21.15.167:0/1126116802 wait complete. 2024-09-11T00:43:54.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e 7 2024-09-11T00:43:55.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.017+0000 7f35c3400640 1 -- 172.21.15.167:0/9485776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 msgr2=0x7f35bc155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.017+0000 7f35c3400640 1 --2- 172.21.15.167:0/9485776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc155750 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35b4005fd0 tx=0x7f35b402a940 comp rx=0 tx=0).stop 2024-09-11T00:43:55.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 -- 172.21.15.167:0/9485776 shutdown_connections 2024-09-11T00:43:55.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 --2- 172.21.15.167:0/9485776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc155750 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 --2- 172.21.15.167:0/9485776 >> v2:172.21.15.167:3300/0 conn(0x7f35bc068b50 0x7f35bc0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 -- 172.21.15.167:0/9485776 >> 172.21.15.167:0/9485776 conn(0x7f35bc070760 msgr2=0x7f35bc070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:55.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 -- 172.21.15.167:0/9485776 shutdown_connections 2024-09-11T00:43:55.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.018+0000 7f35c3400640 1 -- 172.21.15.167:0/9485776 wait complete. 2024-09-11T00:43:55.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.020+0000 7f35c3400640 1 Processor -- start 2024-09-11T00:43:55.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.020+0000 7f35c3400640 1 -- start start 2024-09-11T00:43:55.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35bc068f30 0x7f35bc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc159660 con 0x7f35bc068f30 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc1594e0 con 0x7f35bc068b50 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c3400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc15bc30 con 0x7f35bc0cb7a0 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c0a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c1400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c0a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54814/0 (socket says 172.21.15.167:54814) 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35c0a00640 1 -- 172.21.15.167:0/541757304 learned_addr learned my addr 172.21.15.167:0/541757304 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.022+0000 7f35bbe00640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35bc068f30 0x7f35bc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 -- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 msgr2=0x7f35bc150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 -- 172.21.15.167:0/541757304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35bc068f30 msgr2=0x7f35bc155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35bc068f30 0x7f35bc155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 -- 172.21.15.167:0/541757304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc0c5d80 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c1400640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c0a00640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9c0 tx=0x7f35b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000cde0 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35b0004020 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0004450 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc0ccc70 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc0c57c0 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.023+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f35b0003980 con 0x7f35bc068b50 2024-09-11T00:43:55.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.024+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f35b0003ca0 con 0x7f35bc068b50 2024-09-11T00:43:55.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.024+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc0b07b0 con 0x7f35bc068b50 2024-09-11T00:43:55.028 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.027+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f35bc0b07b0 con 0x7f35bc068b50 2024-09-11T00:43:55.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.101+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e", "id": 7} v 0) -- 0x7f35bc153a80 con 0x7f35bc068b50 2024-09-11T00:43:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.105+0000 7f35b8c00640 1 -- 172.21.15.167:0/541757304 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f35b0026020 con 0x7f35bc068b50 2024-09-11T00:43:55.107 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-09-11T00:43:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 msgr2=0x7f35bc0cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9c0 tx=0x7f35b000ee80 comp rx=0 tx=0).stop 2024-09-11T00:43:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 shutdown_connections 2024-09-11T00:43:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35bc0cb7a0 0x7f35bc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35bc068f30 0x7f35bc155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 --2- 172.21.15.167:0/541757304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35bc068b50 0x7f35bc0cc730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 >> 172.21.15.167:0/541757304 conn(0x7f35bc070760 msgr2=0x7f35bc154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 shutdown_connections 2024-09-11T00:43:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T00:43:55.106+0000 7f35c3400640 1 -- 172.21.15.167:0/541757304 wait complete. 2024-09-11T00:43:55.126 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T00:43:55.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T00:43:55.131 INFO:tasks.ceph.osd.0:Started 2024-09-11T00:43:55.131 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T00:43:55.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T00:43:55.134 INFO:tasks.ceph.osd.1:Started 2024-09-11T00:43:55.135 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T00:43:55.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T00:43:55.138 INFO:tasks.ceph.osd.2:Started 2024-09-11T00:43:55.138 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T00:43:55.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T00:43:55.143 INFO:tasks.ceph.osd.3:Started 2024-09-11T00:43:55.143 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T00:43:55.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T00:43:55.147 INFO:tasks.ceph.osd.4:Started 2024-09-11T00:43:55.147 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T00:43:55.147 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T00:43:55.151 INFO:tasks.ceph.osd.5:Started 2024-09-11T00:43:55.151 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T00:43:55.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T00:43:55.155 INFO:tasks.ceph.osd.6:Started 2024-09-11T00:43:55.155 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T00:43:55.156 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T00:43:55.160 INFO:tasks.ceph.osd.7:Started 2024-09-11T00:43:55.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:43:55.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.375+0000 7f2d7a000640 1 -- 172.21.15.81:0/1172767517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 msgr2=0x7f2d7415e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.375+0000 7f2d7a000640 1 --2- 172.21.15.81:0/1172767517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d7415e560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d740cdac0 tx=0x7f2d6002a5f0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.375+0000 7f2d7a000640 1 -- 172.21.15.81:0/1172767517 shutdown_connections 2024-09-11T00:43:55.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.375+0000 7f2d7a000640 1 --2- 172.21.15.81:0/1172767517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d740cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.375+0000 7f2d7a000640 1 --2- 172.21.15.81:0/1172767517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d7415e560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.376+0000 7f2d7a000640 1 --2- 172.21.15.81:0/1172767517 >> v2:172.21.15.167:3300/0 conn(0x7f2d741548e0 0x7f2d7415af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.376+0000 7f2d7a000640 1 -- 172.21.15.81:0/1172767517 >> 172.21.15.81:0/1172767517 conn(0x7f2d7406ebb0 msgr2=0x7f2d7406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:55.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.376+0000 7f2d7a000640 1 -- 172.21.15.81:0/1172767517 shutdown_connections 2024-09-11T00:43:55.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.376+0000 7f2d7a000640 1 -- 172.21.15.81:0/1172767517 wait complete. 2024-09-11T00:43:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.378+0000 7f2d7a000640 1 Processor -- start 2024-09-11T00:43:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.378+0000 7f2d7a000640 1 -- start start 2024-09-11T00:43:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d741f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 0x7f2d740b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7415dd60 con 0x7f2d740cbe90 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d740cb280 con 0x7f2d741548e0 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d7a000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2d740cb5a0 con 0x7f2d740c4f50 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d73e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d73e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42630/0 (socket says 172.21.15.81:42630) 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d73e00640 1 -- 172.21.15.81:0/3789508703 learned_addr learned my addr 172.21.15.81:0/3789508703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d78c00640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d741f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.380+0000 7f2d79600640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 0x7f2d740b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 -- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 msgr2=0x7f2d741f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d741f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 -- 172.21.15.81:0/3789508703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 msgr2=0x7f2d740b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 -- 172.21.15.81:0/3789508703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d740b42b0 con 0x7f2d741548e0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d73e00640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d78c00640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d741f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d79600640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 0x7f2d740b4a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e770 tx=0x7f2d6c00ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00ccc0 con 0x7f2d741548e0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d6c00ee80 con 0x7f2d741548e0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004260 con 0x7f2d741548e0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d740b6030 con 0x7f2d741548e0 2024-09-11T00:43:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.381+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7415cac0 con 0x7f2d741548e0 2024-09-11T00:43:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.382+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2d6c004b30 con 0x7f2d741548e0 2024-09-11T00:43:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.382+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2d6c003730 con 0x7f2d741548e0 2024-09-11T00:43:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.382+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d741f1230 con 0x7f2d741548e0 2024-09-11T00:43:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.385+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2d741f1230 con 0x7f2d741548e0 2024-09-11T00:43:55.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.449+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d7414e960 con 0x7f2d741548e0 2024-09-11T00:43:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.449+0000 7f2d70c00640 1 -- 172.21.15.81:0/3789508703 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2d7414e960 con 0x7f2d741548e0 2024-09-11T00:43:55.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:43:55.452 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:43:55.103255+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.450+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 msgr2=0x7f2d740b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.450+0000 7f2d7a000640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 0x7f2d740b4a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e770 tx=0x7f2d6c00ec30 comp rx=0 tx=0).stop 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 shutdown_connections 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d741548e0 0x7f2d740b4a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d740cbe90 0x7f2d740b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 --2- 172.21.15.81:0/3789508703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d740c4f50 0x7f2d741f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 >> 172.21.15.81:0/3789508703 conn(0x7f2d7406ebb0 msgr2=0x7f2d74158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:55.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 shutdown_connections 2024-09-11T00:43:55.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:43:55.451+0000 7f2d7a000640 1 -- 172.21.15.81:0/3789508703 wait complete. 2024-09-11T00:43:55.468 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T00:43:55.468 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T00:43:56.275 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:43:56.415 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 -- 172.21.15.81:0/3529956193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f0070600 msgr2=0x7f48f006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3529956193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f0070600 0x7f48f006e910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009830 tx=0x7f48d802a590 comp rx=0 tx=0).stop 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 -- 172.21.15.81:0/3529956193 shutdown_connections 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3529956193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f0070600 0x7f48f006e910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3529956193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0152690 0x7f48f006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 -- 172.21.15.81:0/3529956193 >> 172.21.15.81:0/3529956193 conn(0x7f48f00ccfe0 msgr2=0x7f48f00cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 -- 172.21.15.81:0/3529956193 shutdown_connections 2024-09-11T00:43:56.416 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.413+0000 7f48f4a00640 1 -- 172.21.15.81:0/3529956193 wait complete. 2024-09-11T00:43:56.417 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.414+0000 7f48f4a00640 1 Processor -- start 2024-09-11T00:43:56.417 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 -- start start 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 0x7f48f015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f0152690 0x7f48f00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0152a70 con 0x7f48f0152690 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0158ce0 con 0x7f48f00c79e0 2024-09-11T00:43:56.419 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.415+0000 7f48f4a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f48f01583f0 con 0x7f48f0070600 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48e7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 0x7f48f015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ee800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f0152690 0x7f48f00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48e7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 0x7f48f015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:52610/0 (socket says 172.21.15.81:52610) 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48e7e00640 1 -- 172.21.15.81:0/3943086520 learned_addr learned my addr 172.21.15.81:0/3943086520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:45632/0 (socket says 172.21.15.81:45632) 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 -- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 msgr2=0x7f48f015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 0x7f48f015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 -- 172.21.15.81:0/3943086520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f0152690 msgr2=0x7f48f00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f0152690 0x7f48f00b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.420 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 -- 172.21.15.81:0/3943086520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f015c8b0 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.416+0000 7f48ede00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48e000e9f0 tx=0x7f48e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.417+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e000ccc0 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.417+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48e0004020 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.417+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f00c3fd0 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.417+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e000ce60 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.417+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f0153a70 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.418+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 2) ==== 50324+0+0 (secure 0 0 0) 0x7f48e00035f0 con 0x7f48f0070600 2024-09-11T00:43:56.421 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.418+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f48e00524a0 con 0x7f48f0070600 2024-09-11T00:43:56.422 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.418+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f0074970 con 0x7f48f0070600 2024-09-11T00:43:56.422 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.420+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f48f0074970 con 0x7f48f0070600 2024-09-11T00:43:56.500 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.497+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48f006c920 con 0x7f48f0070600 2024-09-11T00:43:56.500 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.498+0000 7f48e6000640 1 -- 172.21.15.81:0/3943086520 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f48e0004450 con 0x7f48f0070600 2024-09-11T00:43:56.501 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-11T00:43:56.501 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:43:55.103255+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 msgr2=0x7f48f0153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48e000e9f0 tx=0x7f48e000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 shutdown_connections 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f0152690 0x7f48f00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f00c79e0 0x7f48f015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 --2- 172.21.15.81:0/3943086520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f0070600 0x7f48f0153470 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 >> 172.21.15.81:0/3943086520 conn(0x7f48f00ccfe0 msgr2=0x7f48f00ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 shutdown_connections 2024-09-11T00:43:56.502 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:43:56.499+0000 7f48f4a00640 1 -- 172.21.15.81:0/3943086520 wait complete. 2024-09-11T00:43:56.513 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T00:43:56.651 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T00:43:56.649+0000 7ffa536e4640 -1 Falling back to public interface 2024-09-11T00:43:56.690 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-11T00:43:56.688+0000 7fe5cbb41640 -1 Falling back to public interface 2024-09-11T00:43:56.691 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-11T00:43:56.688+0000 7f05f8233640 -1 Falling back to public interface 2024-09-11T00:43:56.691 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-11T00:43:56.688+0000 7f05f6c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-11T00:43:56.691 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-11T00:43:56.688+0000 7fe5ca600640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-09-11T00:43:56.697 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T00:43:56.696+0000 7f1f44e9c640 -1 Falling back to public interface 2024-09-11T00:43:56.698 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-11T00:43:56.696+0000 7f4c3862e640 -1 Falling back to public interface 2024-09-11T00:43:56.706 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T00:43:56.704+0000 7f52e4d69640 -1 Falling back to public interface 2024-09-11T00:43:56.817 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T00:43:56.815+0000 7ff40d200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T00:43:56.821 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T00:43:56.819+0000 7ff40d200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T00:43:57.207 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-11T00:43:57.205+0000 7ff5007db640 -1 Falling back to public interface 2024-09-11T00:43:57.236 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T00:43:57.234+0000 7f1057ef1640 -1 Falling back to public interface 2024-09-11T00:44:00.305 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T00:44:00.303+0000 7ffa536e4640 -1 osd.4 0 log_to_monitors true 2024-09-11T00:44:00.462 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T00:44:00.460+0000 7f52e4d69640 -1 osd.5 0 log_to_monitors true 2024-09-11T00:44:00.506 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-11T00:44:00.504+0000 7f4c3862e640 -1 osd.1 0 log_to_monitors true 2024-09-11T00:44:00.639 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T00:44:00.637+0000 7f1f44e9c640 -1 osd.6 0 log_to_monitors true 2024-09-11T00:44:00.655 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-11T00:44:00.653+0000 7fe5cbb41640 -1 osd.0 0 log_to_monitors true 2024-09-11T00:44:00.670 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-11T00:44:00.668+0000 7f05f8233640 -1 osd.3 0 log_to_monitors true 2024-09-11T00:44:00.893 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T00:44:00.891+0000 7f1057ef1640 -1 osd.7 0 log_to_monitors true 2024-09-11T00:44:01.130 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-11T00:44:01.128+0000 7ff5007db640 -1 osd.2 0 log_to_monitors true 2024-09-11T00:44:02.148 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T00:44:02.146+0000 7ffa4e600640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T00:44:02.155 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T00:44:02.154+0000 7ffa44600640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.320 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:03.541 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.538+0000 7f43be800640 1 -- 172.21.15.81:0/2114166806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c0f10 msgr2=0x7f43b8157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:03.541 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.538+0000 7f43be800640 1 --2- 172.21.15.81:0/2114166806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c0f10 0x7f43b8157520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43a0005fd0 tx=0x7f43a002e900 comp rx=0 tx=0).stop 2024-09-11T00:44:03.541 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.539+0000 7f43be800640 1 -- 172.21.15.81:0/2114166806 shutdown_connections 2024-09-11T00:44:03.541 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.539+0000 7f43be800640 1 --2- 172.21.15.81:0/2114166806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c0f10 0x7f43b8157520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.541 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.539+0000 7f43be800640 1 --2- 172.21.15.81:0/2114166806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b80c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.542 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.539+0000 7f43be800640 1 -- 172.21.15.81:0/2114166806 >> 172.21.15.81:0/2114166806 conn(0x7f43b806ff60 msgr2=0x7f43b8070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:03.542 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.540+0000 7f43be800640 1 -- 172.21.15.81:0/2114166806 shutdown_connections 2024-09-11T00:44:03.542 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.540+0000 7f43be800640 1 -- 172.21.15.81:0/2114166806 wait complete. 2024-09-11T00:44:03.544 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.542+0000 7f43be800640 1 Processor -- start 2024-09-11T00:44:03.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.542+0000 7f43be800640 1 -- start start 2024-09-11T00:44:03.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b8151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:03.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:03.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 0x7f43b814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:03.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80c2f60 con 0x7f43b80c8340 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80c2c80 con 0x7f43b80c0f10 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.544+0000 7f43be800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f43b8156d20 con 0x7f43b80b2020 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b8151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:52630/0 (socket says 172.21.15.81:52630) 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 -- 172.21.15.81:0/2909536132 learned_addr learned my addr 172.21.15.81:0/2909536132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b8151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:45702/0 (socket says 172.21.15.81:45702) 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 -- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 msgr2=0x7f43b8151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b8151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b6a00640 1 -- 172.21.15.81:0/2909536132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 msgr2=0x7f43b814c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:03.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.545+0000 7f43b7e00640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 0x7f43b814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43b6a00640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 0x7f43b814c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43b6a00640 1 -- 172.21.15.81:0/2909536132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b81527b0 con 0x7f43b80c0f10 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43b7e00640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 0x7f43b814c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43b6a00640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a00038f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0003cf0 con 0x7f43b80c0f10 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.546+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b814ae50 con 0x7f43b80c0f10 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.547+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43a00047a0 con 0x7f43b80c0f10 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.547+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004b90 con 0x7f43b80c0f10 2024-09-11T00:44:03.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.547+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81f03e0 con 0x7f43b80c0f10 2024-09-11T00:44:03.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.549+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b81f01f0 con 0x7f43b80c0f10 2024-09-11T00:44:03.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.550+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7f43a0050030 con 0x7f43b80c0f10 2024-09-11T00:44:03.555 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.552+0000 7f43af400640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 0x7f439407a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:03.555 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.552+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f43a00be5d0 con 0x7f43b80c0f10 2024-09-11T00:44:03.555 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.553+0000 7f43b7400640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 0x7f439407a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:03.557 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.554+0000 7f43b7400640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 0x7f439407a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009990 tx=0x7f43a8009110 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:03.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.559+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f43b81527b0 con 0x7f43b80c0f10 2024-09-11T00:44:03.583 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T00:44:03.579+0000 7f52e0600640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T00:44:03.592 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T00:44:03.590+0000 7f52d5c00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.608 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T00:44:03.606+0000 7f1f40800640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T00:44:03.618 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T00:44:03.616+0000 7f1f35e00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.638 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T00:44:03.637+0000 7f1052e00640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T00:44:03.644 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T00:44:03.642+0000 7f1048e00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.880 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-11T00:44:03.877+0000 7ff4fb600640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T00:44:03.886 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-11T00:44:03.884+0000 7fe5c7400640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T00:44:03.891 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-11T00:44:03.888+0000 7ff4f1600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.895 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-11T00:44:03.893+0000 7fe5bca00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.914 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.911+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43b8074d70 con 0x7f43b80c0f10 2024-09-11T00:44:03.915 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.913+0000 7f43af400640 1 -- 172.21.15.81:0/2909536132 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f43a0044030 con 0x7f43b80c0f10 2024-09-11T00:44:03.915 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-11T00:44:03.915 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":14,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:03.394457+0000","last_up_change":"2024-09-11T00:44:02.369967+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:03.918 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.915+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 msgr2=0x7f439407a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:03.918 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.915+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 0x7f439407a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009990 tx=0x7f43a8009110 comp rx=0 tx=0).stop 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.915+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 msgr2=0x7f43b814c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.915+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a00038f0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 shutdown_connections 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4394077ee0 0x7f439407a3a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80c8340 0x7f43b814c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.919 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b80c0f10 0x7f43b814c420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.920 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 --2- 172.21.15.81:0/2909536132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43b80b2020 0x7f43b8151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:03.920 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 >> 172.21.15.81:0/2909536132 conn(0x7f43b806ff60 msgr2=0x7f43b8073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:03.920 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 shutdown_connections 2024-09-11T00:44:03.920 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:03.916+0000 7f43be800640 1 -- 172.21.15.81:0/2909536132 wait complete. 2024-09-11T00:44:03.928 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-11T00:44:03.926+0000 7f4c32a00640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T00:44:03.939 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-11T00:44:03.946 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-11T00:44:03.944+0000 7f05f3000640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T00:44:03.949 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-11T00:44:03.947+0000 7f4c28a00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:03.951 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-11T00:44:03.949+0000 7f05e9000640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:44:10.747 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:10.892 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 -- 172.21.15.81:0/1219224002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 msgr2=0x7f682c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 --2- 172.21.15.81:0/1219224002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c0caaa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6818005fd0 tx=0x7f681802a660 comp rx=0 tx=0).stop 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 -- 172.21.15.81:0/1219224002 shutdown_connections 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 --2- 172.21.15.81:0/1219224002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c0caaa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 --2- 172.21.15.81:0/1219224002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c154750 0x7f682c0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 -- 172.21.15.81:0/1219224002 >> 172.21.15.81:0/1219224002 conn(0x7f682c068be0 msgr2=0x7f682c068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 -- 172.21.15.81:0/1219224002 shutdown_connections 2024-09-11T00:44:10.893 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.891+0000 7f6830c00640 1 -- 172.21.15.81:0/1219224002 wait complete. 2024-09-11T00:44:10.894 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.892+0000 7f6830c00640 1 Processor -- start 2024-09-11T00:44:10.894 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.892+0000 7f6830c00640 1 -- start start 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c0c52d0 0x7f682c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682c154750 0x7f682c1419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f682c15af00 con 0x7f682c0b2c60 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f682c15ac20 con 0x7f682c154750 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.893+0000 7f6830c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f682c15b420 con 0x7f682c0c52d0 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54976/0 (socket says 172.21.15.81:54976) 2024-09-11T00:44:10.896 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 -- 172.21.15.81:0/2846480777 learned_addr learned my addr 172.21.15.81:0/2846480777 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682aa00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c0c52d0 0x7f682c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682be00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682c154750 0x7f682c1419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 -- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c0c52d0 msgr2=0x7f682c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c0c52d0 0x7f682c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 -- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682c154750 msgr2=0x7f682c1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682c154750 0x7f682c1419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 -- 172.21.15.81:0/2846480777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c0cf7f0 con 0x7f682c0b2c60 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.894+0000 7f682b400640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f681c00e790 tx=0x7f681c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.895+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c00eea0 con 0x7f682c0b2c60 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.895+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f681c00cd50 con 0x7f682c0b2c60 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.895+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c010690 con 0x7f682c0b2c60 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.895+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c0cfab0 con 0x7f682c0b2c60 2024-09-11T00:44:10.897 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.895+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c0b5a20 con 0x7f682c0b2c60 2024-09-11T00:44:10.898 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.896+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c0b3c20 con 0x7f682c0b2c60 2024-09-11T00:44:10.898 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.897+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f681c010830 con 0x7f682c0b2c60 2024-09-11T00:44:10.899 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.898+0000 7f6823400640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 0x7f680c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:10.899 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.898+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f681c09a320 con 0x7f682c0b2c60 2024-09-11T00:44:10.900 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.898+0000 7f682aa00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 0x7f680c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:10.900 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.899+0000 7f682aa00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 0x7f680c07a460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6818033000 tx=0x7f6818004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:10.904 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:10.903+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f681c062b10 con 0x7f682c0b2c60 2024-09-11T00:44:11.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:11.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:11.091 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.090+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f682c154b30 con 0x7f682c0b2c60 2024-09-11T00:44:11.092 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.090+0000 7f6823400640 1 -- 172.21.15.81:0/2846480777 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12920 (secure 0 0 0) 0x7f681c067540 con 0x7f682c0b2c60 2024-09-11T00:44:11.092 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-11T00:44:11.092 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":19,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:08.611864+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 msgr2=0x7f680c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 0x7f680c07a460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6818033000 tx=0x7f6818004730 comp rx=0 tx=0).stop 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 msgr2=0x7f682c14a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f681c00e790 tx=0x7f681c00ec50 comp rx=0 tx=0).stop 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 shutdown_connections 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f680c077fa0 0x7f680c07a460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f682c154750 0x7f682c1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.095 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f682c0c52d0 0x7f682c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 --2- 172.21.15.81:0/2846480777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f682c0b2c60 0x7f682c14a380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 >> 172.21.15.81:0/2846480777 conn(0x7f682c068be0 msgr2=0x7f682c06ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:11.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 shutdown_connections 2024-09-11T00:44:11.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-11T00:44:11.093+0000 7f6830c00640 1 -- 172.21.15.81:0/2846480777 wait complete. 2024-09-11T00:44:11.107 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T00:44:11.108 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T00:44:11.108 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T00:44:11.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T00:44:11.151 INFO:tasks.ceph.mds.a:Started 2024-09-11T00:44:11.151 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T00:44:11.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T00:44:11.155 INFO:tasks.ceph.mds.c:Started 2024-09-11T00:44:11.155 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-11T00:44:11.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-11T00:44:11.159 INFO:tasks.ceph.mds.e:Started 2024-09-11T00:44:11.159 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T00:44:11.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T00:44:11.163 INFO:tasks.ceph.mds.b:Started 2024-09-11T00:44:11.163 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T00:44:11.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T00:44:11.167 INFO:tasks.ceph.mds.d:Started 2024-09-11T00:44:11.167 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-11T00:44:11.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-11T00:44:11.171 INFO:tasks.ceph.mds.f:Started 2024-09-11T00:44:11.171 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T00:44:11.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:11.285 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-11T00:44:11.287 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-11T00:44:11.294 INFO:tasks.ceph.mds.e.smithi081.stdout:starting mds.e at 2024-09-11T00:44:11.299 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-11T00:44:11.304 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-09-11T00:44:11.306 INFO:tasks.ceph.mds.f.smithi167.stdout:starting mds.f at 2024-09-11T00:44:11.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 -- 172.21.15.81:0/2646009945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23901548e0 msgr2=0x7f239015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 --2- 172.21.15.81:0/2646009945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23901548e0 0x7f239015af30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2380009830 tx=0x7f238002a5a0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 -- 172.21.15.81:0/2646009945 shutdown_connections 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 --2- 172.21.15.81:0/2646009945 >> v2:172.21.15.167:3300/0 conn(0x7f23900cbe90 0x7f239015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 --2- 172.21.15.81:0/2646009945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23901548e0 0x7f239015af30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 -- 172.21.15.81:0/2646009945 >> 172.21.15.81:0/2646009945 conn(0x7f239006ebb0 msgr2=0x7f239006efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 -- 172.21.15.81:0/2646009945 shutdown_connections 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.342+0000 7f2395c00640 1 -- 172.21.15.81:0/2646009945 wait complete. 2024-09-11T00:44:11.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.343+0000 7f2395c00640 1 Processor -- start 2024-09-11T00:44:11.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.343+0000 7f2395c00640 1 -- start start 2024-09-11T00:44:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23900c4f50 0x7f23901539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23901548e0 0x7f239015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f239015dd60 con 0x7f23901548e0 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23900cb280 con 0x7f23900cbe90 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.344+0000 7f2395c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23900cb5a0 con 0x7f23900c4f50 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:55700/0 (socket says 172.21.15.81:55700) 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 -- 172.21.15.81:0/3150216626 learned_addr learned my addr 172.21.15.81:0/3150216626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238fe00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23900c4f50 0x7f23901539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f2395200640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23901548e0 0x7f239015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 -- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23900c4f50 msgr2=0x7f23901539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23900c4f50 0x7f23901539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 -- 172.21.15.81:0/3150216626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23901548e0 msgr2=0x7f239015bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23901548e0 0x7f239015bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 -- 172.21.15.81:0/3150216626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239014a670 con 0x7f23900cbe90 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.345+0000 7f238f400640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e9c0 tx=0x7f237c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.346+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c00cd80 con 0x7f23900cbe90 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.346+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f237c004020 con 0x7f23900cbe90 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.346+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c004450 con 0x7f23900cbe90 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.346+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2390147720 con 0x7f23900cbe90 2024-09-11T00:44:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.346+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2390147ce0 con 0x7f23900cbe90 2024-09-11T00:44:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.347+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239015af30 con 0x7f23900cbe90 2024-09-11T00:44:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.348+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f237c0035f0 con 0x7f23900cbe90 2024-09-11T00:44:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.349+0000 7f2387e00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 0x7f237007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.349+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f237c09a340 con 0x7f23900cbe90 2024-09-11T00:44:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.349+0000 7f238fe00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 0x7f237007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.350+0000 7f238fe00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 0x7f237007a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2380034000 tx=0x7f2380004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.354+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f237c062b30 con 0x7f23900cbe90 2024-09-11T00:44:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.574+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23900cb920 con 0x7f23900cbe90 2024-09-11T00:44:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.575+0000 7f2387e00640 1 -- 172.21.15.81:0/3150216626 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f237c067560 con 0x7f23900cbe90 2024-09-11T00:44:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:11.577 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-11T00:44:11:293841+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:44:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-11T00:44:11.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 msgr2=0x7f237007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 0x7f237007a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2380034000 tx=0x7f2380004730 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 msgr2=0x7f2390149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e9c0 tx=0x7f237c00ee80 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 shutdown_connections 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2370077f70 0x7f237007a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23901548e0 0x7f239015bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23900cbe90 0x7f2390149990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 --2- 172.21.15.81:0/3150216626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23900c4f50 0x7f23901539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 >> 172.21.15.81:0/3150216626 conn(0x7f239006ebb0 msgr2=0x7f23901515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 shutdown_connections 2024-09-11T00:44:11.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:11.578+0000 7f2395c00640 1 -- 172.21.15.81:0/3150216626 wait complete. 2024-09-11T00:44:13.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 -- 172.21.15.81:0/1022714490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 msgr2=0x7f0590004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 --2- 172.21.15.81:0/1022714490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f0590004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0598006f90 tx=0x7f0590005830 comp rx=0 tx=0).stop 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05abe00640 1 -- 172.21.15.81:0/1022714490 reap_dead start 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 -- 172.21.15.81:0/1022714490 shutdown_connections 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 -- 172.21.15.81:0/1022714490 >> 172.21.15.81:0/1022714490 conn(0x7f05ac0700f0 msgr2=0x7f05ac070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 -- 172.21.15.81:0/1022714490 shutdown_connections 2024-09-11T00:44:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.763+0000 7f05b2800640 1 -- 172.21.15.81:0/1022714490 wait complete. 2024-09-11T00:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.765+0000 7f05b2800640 1 Processor -- start 2024-09-11T00:44:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.765+0000 7f05b2800640 1 -- start start 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.765+0000 7f05b2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.765+0000 7f05b2800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 0x7f05ac1f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.765+0000 7f05b2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 0x7f05ac0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05b2800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0c83a0 con 0x7f0590004020 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05b2800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac158380 con 0x7f05ac15a7b0 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05b2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac06ebd0 con 0x7f05ac1f41b0 2024-09-11T00:44:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55066/0 (socket says 172.21.15.81:55066) 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 -- 172.21.15.81:0/2044302391 learned_addr learned my addr 172.21.15.81:0/2044302391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05aaa00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 0x7f05ac1f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05abe00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 0x7f05ac0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 -- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 msgr2=0x7f05ac0c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 0x7f05ac0c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 -- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 msgr2=0x7f05ac1f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 0x7f05ac1f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 -- 172.21.15.81:0/2044302391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac1f4610 con 0x7f0590004020 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05aaa00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 0x7f05ac1f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05abe00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 0x7f05ac0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.766+0000 7f05ab400640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f059c011d70 tx=0x7f059c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.767+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c011e60 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.767+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f059c003d80 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.767+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c004d60 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.767+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1e4fd0 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.767+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac1f0fa0 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.768+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac06f5e0 con 0x7f0590004020 2024-09-11T00:44:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.769+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f059c018070 con 0x7f0590004020 2024-09-11T00:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.770+0000 7f05a3400640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 0x7f058c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.770+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f059c09a8d0 con 0x7f0590004020 2024-09-11T00:44:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.770+0000 7f05aaa00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 0x7f058c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.771+0000 7f05aaa00640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 0x7f058c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0598033000 tx=0x7f05ac0c7cd0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.774+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f059c063690 con 0x7f0590004020 2024-09-11T00:44:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.990+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05ac06f1b0 con 0x7f0590004020 2024-09-11T00:44:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.991+0000 7f05a3400640 1 -- 172.21.15.81:0/2044302391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5560 (secure 0 0 0) 0x7f059c062f90 con 0x7f0590004020 2024-09-11T00:44:13.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-11T00:44:12:295927+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4411,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T00:44:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-11T00:44:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 msgr2=0x7f058c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 0x7f058c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0598033000 tx=0x7f05ac0c7cd0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 msgr2=0x7f05ac1e70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f059c011d70 tx=0x7f059c00f790 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 shutdown_connections 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f058c077f70 0x7f058c07a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05ac1f41b0 0x7f05ac0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05ac15a7b0 0x7f05ac1f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 --2- 172.21.15.81:0/2044302391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0590004020 0x7f05ac1e70d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 >> 172.21.15.81:0/2044302391 conn(0x7f05ac0700f0 msgr2=0x7f05ac0c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 shutdown_connections 2024-09-11T00:44:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:13.993+0000 7f05b2800640 1 -- 172.21.15.81:0/2044302391 wait complete. 2024-09-11T00:44:14.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T00:44:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 -- 172.21.15.81:0/2253003042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540c8680 msgr2=0x7fe354162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 --2- 172.21.15.81:0/2253003042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540c8680 0x7fe354162d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3540b2270 tx=0x7fe34c02ab50 comp rx=0 tx=0).stop 2024-09-11T00:44:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 -- 172.21.15.81:0/2253003042 shutdown_connections 2024-09-11T00:44:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 --2- 172.21.15.81:0/2253003042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540c8680 0x7fe354162d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 --2- 172.21.15.81:0/2253003042 >> v2:172.21.15.167:3300/0 conn(0x7fe354152610 0x7fe3540c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 -- 172.21.15.81:0/2253003042 >> 172.21.15.81:0/2253003042 conn(0x7fe3540700f0 msgr2=0x7fe354070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 -- 172.21.15.81:0/2253003042 shutdown_connections 2024-09-11T00:44:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.165+0000 7fe35be00640 1 -- 172.21.15.81:0/2253003042 wait complete. 2024-09-11T00:44:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.166+0000 7fe35be00640 1 Processor -- start 2024-09-11T00:44:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 -- start start 2024-09-11T00:44:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe354074860 0x7fe354158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe354152610 0x7fe3541e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe354070cf0 con 0x7fe3540cb4b0 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe35415c140 con 0x7fe354152610 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.167+0000 7fe35be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540c8090 con 0x7fe354074860 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe354074860 0x7fe354158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35634/0 (socket says 172.21.15.81:35634) 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 -- 172.21.15.81:0/4129971938 learned_addr learned my addr 172.21.15.81:0/4129971938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe358a00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe354152610 0x7fe3541e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 -- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe354074860 msgr2=0x7fe354158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe354074860 0x7fe354158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 -- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe354152610 msgr2=0x7fe3541e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe354152610 0x7fe3541e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 -- 172.21.15.81:0/4129971938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540cbbf0 con 0x7fe3540cb4b0 2024-09-11T00:44:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.168+0000 7fe359e00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009d60 tx=0x7fe34c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.169+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c044070 con 0x7fe3540cb4b0 2024-09-11T00:44:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.169+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe34c004250 con 0x7fe3540cb4b0 2024-09-11T00:44:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.169+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3541575b0 con 0x7fe3540cb4b0 2024-09-11T00:44:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.169+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c004680 con 0x7fe3540cb4b0 2024-09-11T00:44:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.169+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3541e1900 con 0x7fe3540cb4b0 2024-09-11T00:44:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.170+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3541529f0 con 0x7fe3540cb4b0 2024-09-11T00:44:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.171+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe34c036400 con 0x7fe3540cb4b0 2024-09-11T00:44:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.172+0000 7fe351600640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 0x7fe33407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.172+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe34c0ba190 con 0x7fe3540cb4b0 2024-09-11T00:44:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.173+0000 7fe359400640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 0x7fe33407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.173+0000 7fe359400640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 0x7fe33407a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe34800bb50 tx=0x7fe34800b2e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.177+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe34c032030 con 0x7fe3540cb4b0 2024-09-11T00:44:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.361+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe3541e1b00 con 0x7fe3540cb4b0 2024-09-11T00:44:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.362+0000 7fe351600640 1 -- 172.21.15.81:0/4129971938 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fe34c004820 con 0x7fe3540cb4b0 2024-09-11T00:44:14.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:44:14.364 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 msgr2=0x7fe33407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 0x7fe33407a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe34800bb50 tx=0x7fe34800b2e0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 msgr2=0x7fe3541e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009d60 tx=0x7fe34c02c8e0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 shutdown_connections 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe334077f70 0x7fe33407a430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3540cb4b0 0x7fe3541e39e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe354152610 0x7fe3541e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 --2- 172.21.15.81:0/4129971938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe354074860 0x7fe354158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 >> 172.21.15.81:0/4129971938 conn(0x7fe3540700f0 msgr2=0x7fe3540c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:14.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 shutdown_connections 2024-09-11T00:44:14.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.364+0000 7fe35be00640 1 -- 172.21.15.81:0/4129971938 wait complete. 2024-09-11T00:44:14.381 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:44:14.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 -- 172.21.15.81:0/2840130569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4198004800 msgr2=0x7f4198004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 --2- 172.21.15.81:0/2840130569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4198004800 0x7f4198004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f419c0016c0 tx=0x7f4198005830 comp rx=0 tx=0).stop 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b6200640 1 -- 172.21.15.81:0/2840130569 reap_dead start 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 -- 172.21.15.81:0/2840130569 shutdown_connections 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 -- 172.21.15.81:0/2840130569 >> 172.21.15.81:0/2840130569 conn(0x7f41b006ffb0 msgr2=0x7f41b00703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 -- 172.21.15.81:0/2840130569 shutdown_connections 2024-09-11T00:44:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.541+0000 7f41b8200640 1 -- 172.21.15.81:0/2840130569 wait complete. 2024-09-11T00:44:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.543+0000 7f41b8200640 1 Processor -- start 2024-09-11T00:44:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.543+0000 7f41b8200640 1 -- start start 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198004800 0x7f41b00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f41b014e350 0x7f41b01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0152c60 con 0x7f41b00c56f0 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41b015bc80 con 0x7f4198004800 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b8200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f41b006ee60 con 0x7f41b014e350 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35652/0 (socket says 172.21.15.81:35652) 2024-09-11T00:44:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b4e00640 1 -- 172.21.15.81:0/1380374058 learned_addr learned my addr 172.21.15.81:0/1380374058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b5800640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198004800 0x7f41b00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b6200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f41b014e350 0x7f41b01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b4e00640 1 -- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f41b014e350 msgr2=0x7f41b01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.544+0000 7f41b4e00640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f41b014e350 0x7f41b01565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b4e00640 1 -- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198004800 msgr2=0x7f41b00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b4e00640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198004800 0x7f41b00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b4e00640 1 -- 172.21.15.81:0/1380374058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b00c5b80 con 0x7f41b00c56f0 2024-09-11T00:44:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b4e00640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f419c02a930 tx=0x7f419c006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c038070 con 0x7f41b00c56f0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c003af0 con 0x7f41b00c56f0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b01558d0 con 0x7f41b00c56f0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c033420 con 0x7f41b00c56f0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.545+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b0156af0 con 0x7f41b00c56f0 2024-09-11T00:44:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.546+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b00725c0 con 0x7f41b00c56f0 2024-09-11T00:44:14.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.547+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f419c0335c0 con 0x7f41b00c56f0 2024-09-11T00:44:14.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.548+0000 7f41ad600640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 0x7f419007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:14.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.548+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f419c0b9320 con 0x7f41b00c56f0 2024-09-11T00:44:14.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.549+0000 7f41b5800640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 0x7f419007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.550+0000 7f41b5800640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 0x7f419007a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006c10 tx=0x7f41a40067a0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:14.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.552+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f419c081a80 con 0x7f41b00c56f0 2024-09-11T00:44:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:14.736+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f41b00cb510 con 0x7f41b00c56f0 2024-09-11T00:44:15.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.312+0000 7f41ad600640 1 -- 172.21.15.81:0/1380374058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f419c0864b0 con 0x7f41b00c56f0 2024-09-11T00:44:15.314 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-11T00:44:15.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.315+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 msgr2=0x7f419007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:15.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.315+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 0x7f419007a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006c10 tx=0x7f41a40067a0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.315+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 msgr2=0x7f41b00c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:15.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.315+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f419c02a930 tx=0x7f419c006360 comp rx=0 tx=0).stop 2024-09-11T00:44:15.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 shutdown_connections 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4190077f70 0x7f419007a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f41b014e350 0x7f41b01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b00c56f0 0x7f41b00c40e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 --2- 172.21.15.81:0/1380374058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198004800 0x7f41b00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 >> 172.21.15.81:0/1380374058 conn(0x7f41b006ffb0 msgr2=0x7f41b0157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 shutdown_connections 2024-09-11T00:44:15.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.316+0000 7f41b8200640 1 -- 172.21.15.81:0/1380374058 wait complete. 2024-09-11T00:44:15.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 -- 172.21.15.81:0/281636021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d80c7360 msgr2=0x7f94d80c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 --2- 172.21.15.81:0/281636021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d80c7360 0x7f94d80c7790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f94d806fc30 tx=0x7f94c402a5f0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 -- 172.21.15.81:0/281636021 shutdown_connections 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 --2- 172.21.15.81:0/281636021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d80c7360 0x7f94d80c7790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 --2- 172.21.15.81:0/281636021 >> v2:172.21.15.167:3300/0 conn(0x7f94d806f760 0x7f94d8070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 -- 172.21.15.81:0/281636021 >> 172.21.15.81:0/281636021 conn(0x7f94d806ff90 msgr2=0x7f94d80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 -- 172.21.15.81:0/281636021 shutdown_connections 2024-09-11T00:44:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.501+0000 7f94e0400640 1 -- 172.21.15.81:0/281636021 wait complete. 2024-09-11T00:44:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.503+0000 7f94e0400640 1 Processor -- start 2024-09-11T00:44:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.503+0000 7f94e0400640 1 -- start start 2024-09-11T00:44:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 0x7f94d8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 0x7f94d814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8074ad0 con 0x7f94d815baa0 2024-09-11T00:44:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80c6bf0 con 0x7f94d806f760 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94e0400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94d8074db0 con 0x7f94d80c7360 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35672/0 (socket says 172.21.15.81:35672) 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 -- 172.21.15.81:0/1216684692 learned_addr learned my addr 172.21.15.81:0/1216684692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94dda00640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 0x7f94d8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 -- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 msgr2=0x7f94d814c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94dd000640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 0x7f94d814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 0x7f94d814c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 -- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 msgr2=0x7f94d8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 0x7f94d8153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94de400640 1 -- 172.21.15.81:0/1216684692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81f0e50 con 0x7f94d815baa0 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94dda00640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 0x7f94d8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.504+0000 7f94dd000640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 0x7f94d814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94de400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c6b0 tx=0x7f94d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0003b70 con 0x7f94d815baa0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d0003d30 con 0x7f94d815baa0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0005330 con 0x7f94d815baa0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81f1c40 con 0x7f94d815baa0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.505+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81f13a0 con 0x7f94d815baa0 2024-09-11T00:44:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.506+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d806a350 con 0x7f94d815baa0 2024-09-11T00:44:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.507+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f94d00054d0 con 0x7f94d815baa0 2024-09-11T00:44:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.508+0000 7f94d5600640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 0x7f94b807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.508+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f94d0099960 con 0x7f94d815baa0 2024-09-11T00:44:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.509+0000 7f94dda00640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 0x7f94b807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.509+0000 7f94dda00640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 0x7f94b807a460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009b50 tx=0x7f94cc005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:15.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.513+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f94d806a350 con 0x7f94d815baa0 2024-09-11T00:44:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:15.698+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f94d80c6280 con 0x7f94d815baa0 2024-09-11T00:44:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.321+0000 7f94d5600640 1 -- 172.21.15.81:0/1216684692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f94d81590b0 con 0x7f94d815baa0 2024-09-11T00:44:16.323 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-11T00:44:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 msgr2=0x7f94b807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 0x7f94b807a460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009b50 tx=0x7f94cc005f90 comp rx=0 tx=0).stop 2024-09-11T00:44:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 msgr2=0x7f94d814cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c6b0 tx=0x7f94d000cb70 comp rx=0 tx=0).stop 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 shutdown_connections 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94b8077fa0 0x7f94b807a460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94d815baa0 0x7f94d814cc10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94d80c7360 0x7f94d814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 --2- 172.21.15.81:0/1216684692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d806f760 0x7f94d8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 >> 172.21.15.81:0/1216684692 conn(0x7f94d806ff90 msgr2=0x7f94d80ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 shutdown_connections 2024-09-11T00:44:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.324+0000 7f94e0400640 1 -- 172.21.15.81:0/1216684692 wait complete. 2024-09-11T00:44:16.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:44:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 -- 172.21.15.81:0/1007380380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0ccff0 msgr2=0x7f52ec0cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 --2- 172.21.15.81:0/1007380380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0ccff0 0x7f52ec0cd420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005fd0 tx=0x7f52e402a940 comp rx=0 tx=0).stop 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 -- 172.21.15.81:0/1007380380 shutdown_connections 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 --2- 172.21.15.81:0/1007380380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0ccff0 0x7f52ec0cd420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 --2- 172.21.15.81:0/1007380380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec0c9ca0 0x7f52ec06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 -- 172.21.15.81:0/1007380380 >> 172.21.15.81:0/1007380380 conn(0x7f52ec068d00 msgr2=0x7f52ec069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 -- 172.21.15.81:0/1007380380 shutdown_connections 2024-09-11T00:44:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.524+0000 7f52f1400640 1 -- 172.21.15.81:0/1007380380 wait complete. 2024-09-11T00:44:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.525+0000 7f52f1400640 1 Processor -- start 2024-09-11T00:44:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.526+0000 7f52f1400640 1 -- start start 2024-09-11T00:44:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.526+0000 7f52f1400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec0ccff0 0x7f52ec154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f1400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec15daf0 0x7f52ec150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f1400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec06d070 con 0x7f52ec0ccff0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f1400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec06cd90 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f1400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec0cc6a0 con 0x7f52ec15daf0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:39550/0 (socket says 172.21.15.81:39550) 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 -- 172.21.15.81:0/3472652701 learned_addr learned my addr 172.21.15.81:0/3472652701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52eb400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec0ccff0 0x7f52ec154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52f0a00640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec15daf0 0x7f52ec150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 -- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec15daf0 msgr2=0x7f52ec150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec15daf0 0x7f52ec150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 -- 172.21.15.81:0/3472652701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec0ccff0 msgr2=0x7f52ec154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec0ccff0 0x7f52ec154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.527+0000 7f52ebe00640 1 -- 172.21.15.81:0/3472652701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec1e5890 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52ebe00640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00ea20 tx=0x7f52dc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00cd80 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52dc010430 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec0cb150 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc010840 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.528+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1e6210 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.529+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec0ca080 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.530+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52dc0109e0 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.531+0000 7f52e3e00640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 0x7f52cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.531+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f52dc09a8f0 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.532+0000 7f52eb400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 0x7f52cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.532+0000 7f52eb400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 0x7f52cc07a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52d8007fd0 tx=0x7f52d8001370 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.536+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f52dc062d60 con 0x7f52ec0c9ca0 2024-09-11T00:44:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:16.757+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f52ec0ce0e0 con 0x7f52ec0c9ca0 2024-09-11T00:44:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.328+0000 7f52e3e00640 1 -- 172.21.15.81:0/3472652701 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f52dc067790 con 0x7f52ec0c9ca0 2024-09-11T00:44:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T00:44:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 msgr2=0x7f52cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 0x7f52cc07a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52d8007fd0 tx=0x7f52d8001370 comp rx=0 tx=0).stop 2024-09-11T00:44:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 msgr2=0x7f52ec14d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00ea20 tx=0x7f52dc00eee0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 shutdown_connections 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f52cc077f70 0x7f52cc07a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52ec15daf0 0x7f52ec150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec0ccff0 0x7f52ec154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 --2- 172.21.15.81:0/3472652701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec0c9ca0 0x7f52ec14d790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.340+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 >> 172.21.15.81:0/3472652701 conn(0x7f52ec068d00 msgr2=0x7f52ec1544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:17.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.343+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 shutdown_connections 2024-09-11T00:44:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.344+0000 7f52f1400640 1 -- 172.21.15.81:0/3472652701 wait complete. 2024-09-11T00:44:17.372 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T00:44:17.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T00:44:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.532+0000 7f6802000640 1 -- 172.21.15.81:0/1565416636 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00047a0 con 0x7f6804158230 2024-09-11T00:44:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 -- 172.21.15.81:0/1565416636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804158230 msgr2=0x7f68040c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 --2- 172.21.15.81:0/1565416636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804158230 0x7f68040c8dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f67f0005fd0 tx=0x7f67f002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 -- 172.21.15.81:0/1565416636 shutdown_connections 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 --2- 172.21.15.81:0/1565416636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804158230 0x7f68040c8dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 --2- 172.21.15.81:0/1565416636 >> v2:172.21.15.167:3300/0 conn(0x7f6804152210 0x7f68040c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 -- 172.21.15.81:0/1565416636 >> 172.21.15.81:0/1565416636 conn(0x7f680406c9e0 msgr2=0x7f680406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 -- 172.21.15.81:0/1565416636 shutdown_connections 2024-09-11T00:44:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.533+0000 7f6808c00640 1 -- 172.21.15.81:0/1565416636 wait complete. 2024-09-11T00:44:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.534+0000 7f6808c00640 1 Processor -- start 2024-09-11T00:44:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.534+0000 7f6808c00640 1 -- start start 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 0x7f680414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 0x7f68041427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68040c85a0 con 0x7f68040c7bf0 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6804158f50 con 0x7f6804158230 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.535+0000 7f6808c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f68041525f0 con 0x7f6804152210 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35688/0 (socket says 172.21.15.81:35688) 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 -- 172.21.15.81:0/2320599005 learned_addr learned my addr 172.21.15.81:0/2320599005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803e00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 0x7f68041427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6802a00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 0x7f680414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 -- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 msgr2=0x7f680414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 0x7f680414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 -- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 msgr2=0x7f68041427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 0x7f68041427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 -- 172.21.15.81:0/2320599005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68040c0eb0 con 0x7f68040c7bf0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803e00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 0x7f68041427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6802a00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 0x7f680414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.536+0000 7f6803400640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67f400ea60 tx=0x7f67f400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.537+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f400cde0 con 0x7f68040c7bf0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.537+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67f4004020 con 0x7f68040c7bf0 2024-09-11T00:44:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.537+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4004450 con 0x7f68040c7bf0 2024-09-11T00:44:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.537+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68040c1150 con 0x7f68040c7bf0 2024-09-11T00:44:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.537+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68040c16f0 con 0x7f68040c7bf0 2024-09-11T00:44:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.538+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68040c74c0 con 0x7f68040c7bf0 2024-09-11T00:44:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.539+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f67f40035f0 con 0x7f68040c7bf0 2024-09-11T00:44:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.540+0000 7f67fb400640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 0x7f67e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.540+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f67f409a790 con 0x7f68040c7bf0 2024-09-11T00:44:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.541+0000 7f6802a00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 0x7f67e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.541+0000 7f6802a00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 0x7f67e407a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67f0033000 tx=0x7f67f0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.545+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f67f4063320 con 0x7f68040c7bf0 2024-09-11T00:44:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:17.736+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6804150ce0 con 0x7f68040c7bf0 2024-09-11T00:44:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.338+0000 7f67fb400640 1 -- 172.21.15.81:0/2320599005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f67f4062c20 con 0x7f68040c7bf0 2024-09-11T00:44:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 msgr2=0x7f67e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 0x7f67e407a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67f0033000 tx=0x7f67f0004730 comp rx=0 tx=0).stop 2024-09-11T00:44:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 msgr2=0x7f68040afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67f400ea60 tx=0x7f67f400ef20 comp rx=0 tx=0).stop 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 shutdown_connections 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f67e4077f70 0x7f67e407a430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6804158230 0x7f68041427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6804152210 0x7f680414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 --2- 172.21.15.81:0/2320599005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68040c7bf0 0x7f68040afda0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 >> 172.21.15.81:0/2320599005 conn(0x7f680406c9e0 msgr2=0x7f68041514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 shutdown_connections 2024-09-11T00:44:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.342+0000 7f6808c00640 1 -- 172.21.15.81:0/2320599005 wait complete. 2024-09-11T00:44:18.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:44:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 -- 172.21.15.81:0/1597133805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c068ff0 msgr2=0x7fc54c0c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 --2- 172.21.15.81:0/1597133805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c068ff0 0x7fc54c0c5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc534009830 tx=0x7fc53402a5a0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 -- 172.21.15.81:0/1597133805 shutdown_connections 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 --2- 172.21.15.81:0/1597133805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c068ff0 0x7fc54c0c5010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 --2- 172.21.15.81:0/1597133805 >> v2:172.21.15.167:3300/0 conn(0x7fc54c154a20 0x7fc54c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 -- 172.21.15.81:0/1597133805 >> 172.21.15.81:0/1597133805 conn(0x7fc54c06d570 msgr2=0x7fc54c0688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 -- 172.21.15.81:0/1597133805 shutdown_connections 2024-09-11T00:44:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.525+0000 7fc551200640 1 -- 172.21.15.81:0/1597133805 wait complete. 2024-09-11T00:44:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.526+0000 7fc551200640 1 Processor -- start 2024-09-11T00:44:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 -- start start 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c0693f0 0x7fc54c1e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c154a20 0x7fc54c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c0ccd50 con 0x7fc54c068ff0 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c0cd030 con 0x7fc54c154a20 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.527+0000 7fc551200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c0cb3e0 con 0x7fc54c0693f0 2024-09-11T00:44:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35704/0 (socket says 172.21.15.81:35704) 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 -- 172.21.15.81:0/56622949 learned_addr learned my addr 172.21.15.81:0/56622949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc543e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c0693f0 0x7fc54c1e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc54a800640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c154a20 0x7fc54c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 -- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c0693f0 msgr2=0x7fc54c1e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c0693f0 0x7fc54c1e11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 -- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c154a20 msgr2=0x7fc54c1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c154a20 0x7fc54c1f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 -- 172.21.15.81:0/56622949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c1e2230 con 0x7fc54c068ff0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc549e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00e9f0 tx=0x7fc53c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00cd80 con 0x7fc54c068ff0 2024-09-11T00:44:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.528+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc53c004020 con 0x7fc54c068ff0 2024-09-11T00:44:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.529+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c004470 con 0x7fc54c068ff0 2024-09-11T00:44:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.529+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c150510 con 0x7fc54c068ff0 2024-09-11T00:44:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.529+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c153f70 con 0x7fc54c068ff0 2024-09-11T00:44:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.530+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c15b130 con 0x7fc54c068ff0 2024-09-11T00:44:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.531+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc53c0035f0 con 0x7fc54c068ff0 2024-09-11T00:44:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.532+0000 7fc542000640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 0x7fc52807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.532+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fc53c09a700 con 0x7fc54c068ff0 2024-09-11T00:44:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.532+0000 7fc543e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 0x7fc52807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.533+0000 7fc543e00640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 0x7fc52807a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc534034000 tx=0x7fc534004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.536+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc53c062a70 con 0x7fc54c068ff0 2024-09-11T00:44:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:18.719+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc54c069db0 con 0x7fc54c068ff0 2024-09-11T00:44:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.343+0000 7fc542000640 1 -- 172.21.15.81:0/56622949 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fc53c0674a0 con 0x7fc54c068ff0 2024-09-11T00:44:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-11T00:44:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 msgr2=0x7fc52807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 0x7fc52807a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc534034000 tx=0x7fc534004730 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 msgr2=0x7fc54c148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00e9f0 tx=0x7fc53c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 shutdown_connections 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.347+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc528077f70 0x7fc52807a430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.348+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc54c154a20 0x7fc54c1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.348+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc54c0693f0 0x7fc54c1e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.348+0000 7fc551200640 1 --2- 172.21.15.81:0/56622949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc54c068ff0 0x7fc54c148dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.348+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 >> 172.21.15.81:0/56622949 conn(0x7fc54c06d570 msgr2=0x7fc54c14aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.348+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 shutdown_connections 2024-09-11T00:44:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.350+0000 7fc551200640 1 -- 172.21.15.81:0/56622949 wait complete. 2024-09-11T00:44:20.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T00:44:20.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 -- 172.21.15.81:0/2582000786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca30152880 msgr2=0x7fca300725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 --2- 172.21.15.81:0/2582000786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca30152880 0x7fca300725c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fca20009860 tx=0x7fca2002a620 comp rx=0 tx=0).stop 2024-09-11T00:44:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 -- 172.21.15.81:0/2582000786 shutdown_connections 2024-09-11T00:44:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 --2- 172.21.15.81:0/2582000786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca30152880 0x7fca300725c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 -- 172.21.15.81:0/2582000786 >> 172.21.15.81:0/2582000786 conn(0x7fca3006ffb0 msgr2=0x7fca300703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 -- 172.21.15.81:0/2582000786 shutdown_connections 2024-09-11T00:44:20.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.540+0000 7fca37200640 1 -- 172.21.15.81:0/2582000786 wait complete. 2024-09-11T00:44:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.541+0000 7fca37200640 1 Processor -- start 2024-09-11T00:44:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.541+0000 7fca37200640 1 -- start start 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca300c7dd0 0x7fca301e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca30152880 0x7fca30155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca30152c60 con 0x7fca30152880 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca3015bc80 con 0x7fca30070b80 2024-09-11T00:44:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca37200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca3006ee60 con 0x7fca300c7dd0 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.542+0000 7fca35200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca30152880 0x7fca30155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca300c7dd0 0x7fca301e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:39586/0 (socket says 172.21.15.81:39586) 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 -- 172.21.15.81:0/3783352889 learned_addr learned my addr 172.21.15.81:0/3783352889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 -- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca300c7dd0 msgr2=0x7fca301e5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca300c7dd0 0x7fca301e5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 -- 172.21.15.81:0/3783352889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca30152880 msgr2=0x7fca30155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca30152880 0x7fca30155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 -- 172.21.15.81:0/3783352889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca30157620 con 0x7fca30070b80 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.543+0000 7fca2fe00640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca20009950 tx=0x7fca20033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.544+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20005c90 con 0x7fca30070b80 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.544+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca20031e50 con 0x7fca30070b80 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.544+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20005280 con 0x7fca30070b80 2024-09-11T00:44:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.544+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca300c2920 con 0x7fca30070b80 2024-09-11T00:44:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.544+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca300c2ea0 con 0x7fca30070b80 2024-09-11T00:44:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.545+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca300725c0 con 0x7fca30070b80 2024-09-11T00:44:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.546+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca20005420 con 0x7fca30070b80 2024-09-11T00:44:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.547+0000 7fca27e00640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 0x7fca1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.547+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fca200bb320 con 0x7fca30070b80 2024-09-11T00:44:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.547+0000 7fca2f400640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 0x7fca1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:20.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.548+0000 7fca2f400640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 0x7fca1007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007f30 tx=0x7fca1c007ec0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:20.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.550+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca30157620 con 0x7fca30070b80 2024-09-11T00:44:20.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:20.734+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fca300c79a0 con 0x7fca30070b80 2024-09-11T00:44:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.353+0000 7fca27e00640 1 -- 172.21.15.81:0/3783352889 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fca2008c020 con 0x7fca30070b80 2024-09-11T00:44:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T00:44:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.362+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 msgr2=0x7fca1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.362+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 0x7fca1007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007f30 tx=0x7fca1c007ec0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.362+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 msgr2=0x7fca300c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.362+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca20009950 tx=0x7fca20033c20 comp rx=0 tx=0).stop 2024-09-11T00:44:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 shutdown_connections 2024-09-11T00:44:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca10077f70 0x7fca1007a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca30152880 0x7fca30155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca300c7dd0 0x7fca301e5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 --2- 172.21.15.81:0/3783352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30070b80 0x7fca300c3760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 >> 172.21.15.81:0/3783352889 conn(0x7fca3006ffb0 msgr2=0x7fca3006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.363+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 shutdown_connections 2024-09-11T00:44:21.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.364+0000 7fca37200640 1 -- 172.21.15.81:0/3783352889 wait complete. 2024-09-11T00:44:21.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T00:44:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.551+0000 7fced1a00640 1 -- 172.21.15.81:0/1662363867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc159150 msgr2=0x7fcecc15bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.551+0000 7fced1a00640 1 --2- 172.21.15.81:0/1662363867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc159150 0x7fcecc15bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcec4005fd0 tx=0x7fcec402a9f0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 -- 172.21.15.81:0/1662363867 shutdown_connections 2024-09-11T00:44:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 --2- 172.21.15.81:0/1662363867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc070ab0 0x7fcecc15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 --2- 172.21.15.81:0/1662363867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc159150 0x7fcecc15bfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 -- 172.21.15.81:0/1662363867 >> 172.21.15.81:0/1662363867 conn(0x7fcecc06ff90 msgr2=0x7fcecc0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 -- 172.21.15.81:0/1662363867 shutdown_connections 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.552+0000 7fced1a00640 1 -- 172.21.15.81:0/1662363867 wait complete. 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.553+0000 7fced1a00640 1 Processor -- start 2024-09-11T00:44:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.553+0000 7fced1a00640 1 -- start start 2024-09-11T00:44:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcecc070ab0 0x7fcecc0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc159150 0x7fcecc156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc158950 con 0x7fcecc152780 2024-09-11T00:44:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc074d30 con 0x7fcecc070ab0 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fced1a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc0ccce0 con 0x7fcecc159150 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fceca000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fceca000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35744/0 (socket says 172.21.15.81:35744) 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.554+0000 7fceca000640 1 -- 172.21.15.81:0/4286026324 learned_addr learned my addr 172.21.15.81:0/4286026324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fcecb400640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc159150 0x7fcecc156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fcecaa00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcecc070ab0 0x7fcecc0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 -- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc159150 msgr2=0x7fcecc156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc159150 0x7fcecc156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 -- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcecc070ab0 msgr2=0x7fcecc0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcecc070ab0 0x7fcecc0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 -- 172.21.15.81:0/4286026324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc155be0 con 0x7fcecc152780 2024-09-11T00:44:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fceca000640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fceb800d780 tx=0x7fceb800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8017070 con 0x7fcecc152780 2024-09-11T00:44:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fceb8009b10 con 0x7fcecc152780 2024-09-11T00:44:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8010460 con 0x7fcecc152780 2024-09-11T00:44:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.555+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc0b1440 con 0x7fcecc152780 2024-09-11T00:44:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.556+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc0b1160 con 0x7fcecc152780 2024-09-11T00:44:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.556+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc0c5ed0 con 0x7fcecc152780 2024-09-11T00:44:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.558+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fceb8010600 con 0x7fcecc152780 2024-09-11T00:44:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.559+0000 7fcec2a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 0x7fceac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.559+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7fceb809a510 con 0x7fcecc152780 2024-09-11T00:44:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.559+0000 7fcecaa00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 0x7fceac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.560+0000 7fcecaa00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 0x7fceac07a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcebc004f60 tx=0x7fcebc007e30 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.563+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fceb8062600 con 0x7fcecc152780 2024-09-11T00:44:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:21.785+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fcecc151f40 con 0x7fcecc152780 2024-09-11T00:44:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.381+0000 7fcec2a00640 1 -- 172.21.15.81:0/4286026324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fceb8067030 con 0x7fcecc152780 2024-09-11T00:44:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 msgr2=0x7fceac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 0x7fceac07a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcebc004f60 tx=0x7fcebc007e30 comp rx=0 tx=0).stop 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 msgr2=0x7fcecc1eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fceb800d780 tx=0x7fceb800dc40 comp rx=0 tx=0).stop 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 shutdown_connections 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fceac077f70 0x7fceac07a430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcecc159150 0x7fcecc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc152780 0x7fcecc1eef50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 --2- 172.21.15.81:0/4286026324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcecc070ab0 0x7fcecc0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 >> 172.21.15.81:0/4286026324 conn(0x7fcecc06ff90 msgr2=0x7fcecc0c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 shutdown_connections 2024-09-11T00:44:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.383+0000 7fced1a00640 1 -- 172.21.15.81:0/4286026324 wait complete. 2024-09-11T00:44:22.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 -- 172.21.15.81:0/3475580179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 msgr2=0x7fc670004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 --2- 172.21.15.81:0/3475580179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 0x7fc670004800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc67400ac30 tx=0x7fc670005830 comp rx=0 tx=0).stop 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc68e400640 1 -- 172.21.15.81:0/3475580179 reap_dead start 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 -- 172.21.15.81:0/3475580179 shutdown_connections 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 -- 172.21.15.81:0/3475580179 >> 172.21.15.81:0/3475580179 conn(0x7fc6880700f0 msgr2=0x7fc688070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 -- 172.21.15.81:0/3475580179 shutdown_connections 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.558+0000 7fc690400640 1 -- 172.21.15.81:0/3475580179 wait complete. 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.559+0000 7fc690400640 1 Processor -- start 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 -- start start 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 0x7fc6881e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688148f70 0x7fc6881467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880c26d0 con 0x7fc68814a760 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880c21b0 con 0x7fc670003f70 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.560+0000 7fc690400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc688148070 con 0x7fc688148f70 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35764/0 (socket says 172.21.15.81:35764) 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 -- 172.21.15.81:0/4129876655 learned_addr learned my addr 172.21.15.81:0/4129876655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68e400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688148f70 0x7fc6881467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68da00640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 0x7fc6881e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 -- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688148f70 msgr2=0x7fc6881467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688148f70 0x7fc6881467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 -- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 msgr2=0x7fc6881e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 0x7fc6881e5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 -- 172.21.15.81:0/4129876655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688149ca0 con 0x7fc68814a760 2024-09-11T00:44:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.561+0000 7fc68d000640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc67400ab80 tx=0x7fc674034e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.562+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674044070 con 0x7fc68814a760 2024-09-11T00:44:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.562+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc67403f500 con 0x7fc68814a760 2024-09-11T00:44:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.562+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6881482c0 con 0x7fc68814a760 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.562+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674039040 con 0x7fc68814a760 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.562+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc688149f60 con 0x7fc68814a760 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.563+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688070e80 con 0x7fc68814a760 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.564+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc67400b040 con 0x7fc68814a760 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.565+0000 7fc685600640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 0x7fc66807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.565+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc6740ba5f0 con 0x7fc68814a760 2024-09-11T00:44:22.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.566+0000 7fc68da00640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 0x7fc66807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.566+0000 7fc68da00640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 0x7fc66807a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c000ed0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:22.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.569+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc674082780 con 0x7fc68814a760 2024-09-11T00:44:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.790+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6880c2a30 con 0x7fc68814a760 2024-09-11T00:44:22.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.791+0000 7fc685600640 1 -- 172.21.15.81:0/4129876655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6873 (secure 0 0 0) 0x7fc6740871b0 con 0x7fc68814a760 2024-09-11T00:44:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:22.793 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"btime":"2024-09-11T00:44:22:383499+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:22.370196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-09-11T00:44:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 msgr2=0x7fc66807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 0x7fc66807a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c000ed0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 msgr2=0x7fc688155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc67400ab80 tx=0x7fc674034e20 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 shutdown_connections 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc668077f70 0x7fc66807a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc688148f70 0x7fc6881467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc68814a760 0x7fc688155a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 --2- 172.21.15.81:0/4129876655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc670003f70 0x7fc6881e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 >> 172.21.15.81:0/4129876655 conn(0x7fc6880700f0 msgr2=0x7fc68814eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 shutdown_connections 2024-09-11T00:44:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.793+0000 7fc690400640 1 -- 172.21.15.81:0/4129876655 wait complete. 2024-09-11T00:44:22.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 -- 172.21.15.81:0/3367820847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf8152780 msgr2=0x7fbcf80c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 --2- 172.21.15.81:0/3367820847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf8152780 0x7fbcf80c8a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcf806a5a0 tx=0x7fbce802a530 comp rx=0 tx=0).stop 2024-09-11T00:44:22.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 -- 172.21.15.81:0/3367820847 shutdown_connections 2024-09-11T00:44:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 --2- 172.21.15.81:0/3367820847 >> v2:172.21.15.167:3300/0 conn(0x7fbcf815b880 0x7fbcf80c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 --2- 172.21.15.81:0/3367820847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf8152780 0x7fbcf80c8a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 -- 172.21.15.81:0/3367820847 >> 172.21.15.81:0/3367820847 conn(0x7fbcf80ca9b0 msgr2=0x7fbcf80cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 -- 172.21.15.81:0/3367820847 shutdown_connections 2024-09-11T00:44:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.964+0000 7fbcf7200640 1 -- 172.21.15.81:0/3367820847 wait complete. 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.966+0000 7fbcf7200640 1 Processor -- start 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.966+0000 7fbcf7200640 1 -- start start 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 0x7fbcf806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 0x7fbcf81f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8158290 con 0x7fbcf815b880 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf8159140 con 0x7fbcf8152780 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf80cb4d0 con 0x7fbcf80c3110 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35780/0 (socket says 172.21.15.81:35780) 2024-09-11T00:44:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 -- 172.21.15.81:0/4087407532 learned_addr learned my addr 172.21.15.81:0/4087407532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf5e00640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 0x7fbcf806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf5400640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 0x7fbcf81f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 -- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 msgr2=0x7fbcf806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 0x7fbcf806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 -- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 msgr2=0x7fbcf81f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 0x7fbcf81f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf6800640 1 -- 172.21.15.81:0/4087407532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf815aff0 con 0x7fbcf815b880 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf5e00640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 0x7fbcf806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.967+0000 7fbcf5400640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 0x7fbcf81f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcf6800640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7b0 tx=0x7fbcf000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbcf815b880 2024-09-11T00:44:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf0005070 con 0x7fbcf815b880 2024-09-11T00:44:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf815b2d0 con 0x7fbcf815b880 2024-09-11T00:44:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00054c0 con 0x7fbcf815b880 2024-09-11T00:44:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.968+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81f3ea0 con 0x7fbcf815b880 2024-09-11T00:44:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.969+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf8076620 con 0x7fbcf815b880 2024-09-11T00:44:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.970+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbcf0005660 con 0x7fbcf815b880 2024-09-11T00:44:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.971+0000 7fbcee000640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 0x7fbcd807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.971+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbcf0099b20 con 0x7fbcf815b880 2024-09-11T00:44:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.971+0000 7fbcf5e00640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 0x7fbcd807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:22.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.972+0000 7fbcf5e00640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 0x7fbcd807a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbce8034000 tx=0x7fbce8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:22.975+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbcf80c9580 con 0x7fbcf815b880 2024-09-11T00:44:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.161+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcf80cb7e0 con 0x7fbcf815b880 2024-09-11T00:44:23.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.162+0000 7fbcee000640 1 -- 172.21.15.81:0/4087407532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fbcf0062240 con 0x7fbcf815b880 2024-09-11T00:44:23.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:23.164 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 msgr2=0x7fbcd807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 0x7fbcd807a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbce8034000 tx=0x7fbce8004730 comp rx=0 tx=0).stop 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 msgr2=0x7fbcf81f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7b0 tx=0x7fbcf000cc70 comp rx=0 tx=0).stop 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 shutdown_connections 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbcd8077f70 0x7fbcd807a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcf815b880 0x7fbcf81f0f60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcf8152780 0x7fbcf81f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 --2- 172.21.15.81:0/4087407532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcf80c3110 0x7fbcf806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 >> 172.21.15.81:0/4087407532 conn(0x7fbcf80ca9b0 msgr2=0x7fbcf80c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 shutdown_connections 2024-09-11T00:44:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.164+0000 7fbcf7200640 1 -- 172.21.15.81:0/4087407532 wait complete. 2024-09-11T00:44:23.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 -- 172.21.15.81:0/2297850227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 msgr2=0x7f9b7815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 --2- 172.21.15.81:0/2297850227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b7815a7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005fd0 tx=0x7f9b6002a670 comp rx=0 tx=0).stop 2024-09-11T00:44:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 -- 172.21.15.81:0/2297850227 shutdown_connections 2024-09-11T00:44:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 --2- 172.21.15.81:0/2297850227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b7815ad10 0x7f9b780d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 --2- 172.21.15.81:0/2297850227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b7815a7d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 -- 172.21.15.81:0/2297850227 >> 172.21.15.81:0/2297850227 conn(0x7f9b7806d570 msgr2=0x7f9b7806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 -- 172.21.15.81:0/2297850227 shutdown_connections 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.340+0000 7f9b7e600640 1 -- 172.21.15.81:0/2297850227 wait complete. 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.342+0000 7f9b7e600640 1 Processor -- start 2024-09-11T00:44:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.342+0000 7f9b7e600640 1 -- start start 2024-09-11T00:44:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b78154a10 0x7f9b78147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b7815ad10 0x7f9b78153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7815e780 con 0x7f9b780cb1d0 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7815e4a0 con 0x7f9b7815ad10 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b7e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9b78154df0 con 0x7f9b78154a10 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b77400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b77400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35798/0 (socket says 172.21.15.81:35798) 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b77400640 1 -- 172.21.15.81:0/3901133178 learned_addr learned my addr 172.21.15.81:0/3901133178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b77e00640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b7815ad10 0x7f9b78153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.343+0000 7f9b6fe00640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b78154a10 0x7f9b78147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 -- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b78154a10 msgr2=0x7f9b78147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b78154a10 0x7f9b78147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 -- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b7815ad10 msgr2=0x7f9b78153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b7815ad10 0x7f9b78153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 -- 172.21.15.81:0/3901133178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7814a650 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b77400640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800c450 tx=0x7f9b6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b680052d0 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b68005470 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012870 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7815a300 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.344+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b780b4b50 con 0x7f9b780cb1d0 2024-09-11T00:44:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.345+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7815a7d0 con 0x7f9b780cb1d0 2024-09-11T00:44:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.346+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9b680035f0 con 0x7f9b780cb1d0 2024-09-11T00:44:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.347+0000 7f9b6f400640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 0x7f9b5407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.347+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9b68099ab0 con 0x7f9b780cb1d0 2024-09-11T00:44:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.348+0000 7f9b6fe00640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 0x7f9b5407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.348+0000 7f9b6fe00640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 0x7f9b5407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b60033000 tx=0x7f9b60004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:23.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.351+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9b68061c10 con 0x7f9b780cb1d0 2024-09-11T00:44:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.538+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b780ca530 con 0x7f9b780cb1d0 2024-09-11T00:44:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.540+0000 7f9b6f400640 1 -- 172.21.15.81:0/3901133178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f9b68066640 con 0x7f9b780cb1d0 2024-09-11T00:44:23.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:23.542 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.542+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 msgr2=0x7f9b5407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.542+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 0x7f9b5407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b60033000 tx=0x7f9b60004730 comp rx=0 tx=0).stop 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.542+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 msgr2=0x7f9b78158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.542+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800c450 tx=0x7f9b6800c910 comp rx=0 tx=0).stop 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 shutdown_connections 2024-09-11T00:44:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9b54077f70 0x7f9b5407a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b7815ad10 0x7f9b78153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b78154a10 0x7f9b78147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 --2- 172.21.15.81:0/3901133178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b780cb1d0 0x7f9b78158430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 >> 172.21.15.81:0/3901133178 conn(0x7f9b7806d570 msgr2=0x7f9b780cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 shutdown_connections 2024-09-11T00:44:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.543+0000 7f9b7e600640 1 -- 172.21.15.81:0/3901133178 wait complete. 2024-09-11T00:44:23.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 -- 172.21.15.81:0/1670777576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 msgr2=0x7f2ae80c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 --2- 172.21.15.81:0/1670777576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae80c0f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ae815c630 tx=0x7f2ad802ab20 comp rx=0 tx=0).stop 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 -- 172.21.15.81:0/1670777576 shutdown_connections 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 --2- 172.21.15.81:0/1670777576 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 0x7f2ae80c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 --2- 172.21.15.81:0/1670777576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae80c0f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 -- 172.21.15.81:0/1670777576 >> 172.21.15.81:0/1670777576 conn(0x7f2ae80700f0 msgr2=0x7f2ae8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 -- 172.21.15.81:0/1670777576 shutdown_connections 2024-09-11T00:44:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.736+0000 7f2aefa00640 1 -- 172.21.15.81:0/1670777576 wait complete. 2024-09-11T00:44:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.738+0000 7f2aefa00640 1 Processor -- start 2024-09-11T00:44:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.738+0000 7f2aefa00640 1 -- start start 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 0x7f2ae814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ae80cb730 0x7f2ae81f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae8070cf0 con 0x7f2ae8152610 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae815c140 con 0x7f2ae80cb730 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aefa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae81529f0 con 0x7f2ae8074860 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35804/0 (socket says 172.21.15.81:35804) 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 -- 172.21.15.81:0/2830508167 learned_addr learned my addr 172.21.15.81:0/2830508167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aed000640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 0x7f2ae814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2aeda00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ae80cb730 0x7f2ae81f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 -- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 msgr2=0x7f2ae814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 0x7f2ae814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 -- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ae80cb730 msgr2=0x7f2ae81f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ae80cb730 0x7f2ae81f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.739+0000 7f2ae7e00640 1 -- 172.21.15.81:0/2830508167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae814e5a0 con 0x7f2ae8152610 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2ae7e00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400c970 tx=0x7f2ad400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4007c70 con 0x7f2ae8152610 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ad400f450 con 0x7f2ae8152610 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400f8a0 con 0x7f2ae8152610 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae81f04b0 con 0x7f2ae8152610 2024-09-11T00:44:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.740+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae81f0770 con 0x7f2ae8152610 2024-09-11T00:44:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.741+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae80c2ea0 con 0x7f2ae8152610 2024-09-11T00:44:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.742+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ad400fa40 con 0x7f2ae8152610 2024-09-11T00:44:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.743+0000 7f2ae4c00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 0x7f2ac807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.743+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2ad409a920 con 0x7f2ae8152610 2024-09-11T00:44:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.743+0000 7f2aed000640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 0x7f2ac807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.744+0000 7f2aed000640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 0x7f2ac807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8035000 tx=0x7f2ad8038040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:23.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.747+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ad4014030 con 0x7f2ae8152610 2024-09-11T00:44:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.966+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ae80c2a70 con 0x7f2ae8152610 2024-09-11T00:44:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.967+0000 7f2ae4c00640 1 -- 172.21.15.81:0/2830508167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6873 (secure 0 0 0) 0x7f2ad4063050 con 0x7f2ae8152610 2024-09-11T00:44:23.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:23.968 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"btime":"2024-09-11T00:44:22:383499+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:22.370196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:23.969 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 msgr2=0x7f2ac807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 0x7f2ac807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8035000 tx=0x7f2ad8038040 comp rx=0 tx=0).stop 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 msgr2=0x7f2ae8144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400c970 tx=0x7f2ad400ce30 comp rx=0 tx=0).stop 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 shutdown_connections 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2ac8077f70 0x7f2ac807a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ae80cb730 0x7f2ae81f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae8152610 0x7f2ae8144e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 --2- 172.21.15.81:0/2830508167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ae8074860 0x7f2ae814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.969+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 >> 172.21.15.81:0/2830508167 conn(0x7f2ae80700f0 msgr2=0x7f2ae814fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.970+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 shutdown_connections 2024-09-11T00:44:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:23.970+0000 7f2aefa00640 1 -- 172.21.15.81:0/2830508167 wait complete. 2024-09-11T00:44:23.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.141+0000 7faf39800640 1 -- 172.21.15.81:0/1106017219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340c4f50 msgr2=0x7faf3415e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.141+0000 7faf39800640 1 --2- 172.21.15.81:0/1106017219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340c4f50 0x7faf3415e560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf340ca5f0 tx=0x7faf2c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 -- 172.21.15.81:0/1106017219 shutdown_connections 2024-09-11T00:44:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 --2- 172.21.15.81:0/1106017219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340c4f50 0x7faf3415e560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 --2- 172.21.15.81:0/1106017219 >> v2:172.21.15.167:3300/0 conn(0x7faf340cbe90 0x7faf3415af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 -- 172.21.15.81:0/1106017219 >> 172.21.15.81:0/1106017219 conn(0x7faf3406ebb0 msgr2=0x7faf3406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 -- 172.21.15.81:0/1106017219 shutdown_connections 2024-09-11T00:44:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.142+0000 7faf39800640 1 -- 172.21.15.81:0/1106017219 wait complete. 2024-09-11T00:44:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.143+0000 7faf39800640 1 Processor -- start 2024-09-11T00:44:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.143+0000 7faf39800640 1 -- start start 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340cbe90 0x7faf3414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 0x7faf3414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf3415dd60 con 0x7faf340cbe90 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf340cb280 con 0x7faf340c4f50 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.144+0000 7faf39800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7faf340cb5a0 con 0x7faf341548e0 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:41892/0 (socket says 172.21.15.81:41892) 2024-09-11T00:44:24.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 -- 172.21.15.81:0/1201938879 learned_addr learned my addr 172.21.15.81:0/1201938879 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:24.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf38e00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 0x7faf3414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:24.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf2b400640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340cbe90 0x7faf3414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 -- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 msgr2=0x7faf3414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 0x7faf3414ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 -- 172.21.15.81:0/1201938879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340cbe90 msgr2=0x7faf3414a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340cbe90 0x7faf3414a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 -- 172.21.15.81:0/1201938879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf341f4a60 con 0x7faf340c4f50 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf38e00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 0x7faf3414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.145+0000 7faf33e00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c800 tx=0x7faf2400ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.146+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24017070 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.146+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf24003da0 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.146+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3415d250 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.146+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf240052d0 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.146+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3415d810 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.147+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3415af30 con 0x7faf340c4f50 2024-09-11T00:44:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.148+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf24038ac0 con 0x7faf340c4f50 2024-09-11T00:44:24.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.149+0000 7faf30c00640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 0x7faf1007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:24.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.149+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faf24099a90 con 0x7faf340c4f50 2024-09-11T00:44:24.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.149+0000 7faf2b400640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 0x7faf1007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:24.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.150+0000 7faf2b400640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 0x7faf1007a460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf340b5e00 tx=0x7faf1c00b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:24.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.153+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf340cc760 con 0x7faf340c4f50 2024-09-11T00:44:24.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.337+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf340c6140 con 0x7faf340c4f50 2024-09-11T00:44:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.339+0000 7faf30c00640 1 -- 172.21.15.81:0/1201938879 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7faf24061b50 con 0x7faf340c4f50 2024-09-11T00:44:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:24.341 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 msgr2=0x7faf1007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 0x7faf1007a460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf340b5e00 tx=0x7faf1c00b390 comp rx=0 tx=0).stop 2024-09-11T00:44:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 msgr2=0x7faf341f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c800 tx=0x7faf2400ccc0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 shutdown_connections 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7faf10077fa0 0x7faf1007a460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf341548e0 0x7faf3414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf340cbe90 0x7faf3414a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 --2- 172.21.15.81:0/1201938879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf340c4f50 0x7faf341f3ff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 >> 172.21.15.81:0/1201938879 conn(0x7faf3406ebb0 msgr2=0x7faf340c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 shutdown_connections 2024-09-11T00:44:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:24.342+0000 7faf39800640 1 -- 172.21.15.81:0/1201938879 wait complete. 2024-09-11T00:44:24.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:44:16.758683+0000', 'modified': '2024-09-11T00:44:22.370196+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4411': {'gid': 4411, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6835/1821136348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 1821136348}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 1821136348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4411, 'qdb_cluster': [4411]} 2024-09-11T00:44:24.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:44:24.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 -- 172.21.15.81:0/3999797056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 msgr2=0x7f082c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 --2- 172.21.15.81:0/3999797056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f082c004c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08300016c0 tx=0x7f082c005830 comp rx=0 tx=0).stop 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 -- 172.21.15.81:0/3999797056 shutdown_connections 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 --2- 172.21.15.81:0/3999797056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f082c004c80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 -- 172.21.15.81:0/3999797056 >> 172.21.15.81:0/3999797056 conn(0x7f08440700f0 msgr2=0x7f0844070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 -- 172.21.15.81:0/3999797056 shutdown_connections 2024-09-11T00:44:25.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.123+0000 7f084be00640 1 -- 172.21.15.81:0/3999797056 wait complete. 2024-09-11T00:44:25.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.125+0000 7f084be00640 1 Processor -- start 2024-09-11T00:44:25.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.125+0000 7f084be00640 1 -- start start 2024-09-11T00:44:25.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.125+0000 7f084be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.125+0000 7f084be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 0x7f0844154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f084be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 0x7f084415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f084be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0844070cf0 con 0x7f082c004800 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f084be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f084415c140 con 0x7f08441530a0 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f084be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f08441529f0 con 0x7f084414b810 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55176/0 (socket says 172.21.15.81:55176) 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 -- 172.21.15.81:0/2033257704 learned_addr learned my addr 172.21.15.81:0/2033257704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849e00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 0x7f084415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0848a00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 0x7f0844154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 -- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 msgr2=0x7f0844154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 0x7f0844154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 -- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 msgr2=0x7f084415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 0x7f084415a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 -- 172.21.15.81:0/2033257704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08441ef2a0 con 0x7f082c004800 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849e00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 0x7f084415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0848a00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 0x7f0844154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.126+0000 7f0849400640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0838011d40 tx=0x7f083800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.127+0000 7f0841600640 1 -- 172.21.15.81:0/2033257704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838003d80 con 0x7f082c004800 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.127+0000 7f0841600640 1 -- 172.21.15.81:0/2033257704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0838004b20 con 0x7f082c004800 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.127+0000 7f0841600640 1 -- 172.21.15.81:0/2033257704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838004050 con 0x7f082c004800 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.127+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08441e4630 con 0x7f082c004800 2024-09-11T00:44:25.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.127+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08441ee7c0 con 0x7f082c004800 2024-09-11T00:44:25.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.129+0000 7f0841600640 1 -- 172.21.15.81:0/2033257704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0838018070 con 0x7f082c004800 2024-09-11T00:44:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.130+0000 7f0841600640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 0x7f082407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.130+0000 7f0841600640 1 -- 172.21.15.81:0/2033257704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f083809aff0 con 0x7f082c004800 2024-09-11T00:44:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.130+0000 7f0848a00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 0x7f082407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.130+0000 7f084edf0740 1 Processor -- start 2024-09-11T00:44:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.130+0000 7f084edf0740 1 -- start start 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f0848a00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 0x7f082407a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0830032000 tx=0x7f0830001190 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e8106e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e5550 0x55e8106e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e81066d430 con 0x55e8106e8150 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e81065d5d0 con 0x55e8106e5550 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.131+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e81064ca00 con 0x55e8106e7d70 2024-09-11T00:44:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55180/0 (socket says 172.21.15.81:55180) 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 -- 172.21.15.81:0/4169377109 learned_addr learned my addr 172.21.15.81:0/4169377109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849400640 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e8106e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0848a00640 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e5550 0x55e8106e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 -- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 msgr2=0x55e8106e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e8106e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 -- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e5550 msgr2=0x55e8106e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e5550 0x55e8106e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 -- 172.21.15.81:0/4169377109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e810615520 con 0x55e8106e8150 2024-09-11T00:44:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0849e00640 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0844074fb0 tx=0x7f083c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd704653b69a557 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.132+0000 7f0835c00640 1 -- 172.21.15.81:0/4169377109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c019070 con 0x55e8106e8150 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f0835c00640 1 -- 172.21.15.81:0/4169377109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f083c010c30 con 0x55e8106e8150 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f0835c00640 1 -- 172.21.15.81:0/4169377109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c012440 con 0x55e8106e8150 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 -- 172.21.15.81:0/4169377109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 msgr2=0x55e8107367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0844074fb0 tx=0x7f083c004c50 comp rx=0 tx=0).stop 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 -- 172.21.15.81:0/4169377109 shutdown_connections 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e8107367d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e5550 0x55e8106e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 --2- 172.21.15.81:0/4169377109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e8106e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 -- 172.21.15.81:0/4169377109 >> 172.21.15.81:0/4169377109 conn(0x55e8106e5f50 msgr2=0x55e8106e7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 -- 172.21.15.81:0/4169377109 shutdown_connections 2024-09-11T00:44:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.133+0000 7f084edf0740 1 -- 172.21.15.81:0/4169377109 wait complete. 2024-09-11T00:44:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.134+0000 7f084edf0740 1 -- start start 2024-09-11T00:44:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.134+0000 7f084edf0740 1 Processor -- start 2024-09-11T00:44:25.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e81073e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e810715b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8105f3330 con 0x55e810721e80 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e810650810 con 0x55e8106e8150 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e8103bd620 con 0x55e8106e7d70 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f084edf0740 10 client.0 _ll_register_callbacks cb 0x55e8105f8420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f0849e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f0849e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55184/0 (socket says 172.21.15.81:55184) 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f0849e00640 1 -- 172.21.15.81:0/3193056142 learned_addr learned my addr 172.21.15.81:0/3193056142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f0849400640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e81073e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.135+0000 7f0848a00640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e810715b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 -- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 msgr2=0x55e81073e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e81073e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 -- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 msgr2=0x55e810715b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e810715b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 -- 172.21.15.81:0/3193056142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8103ae850 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f0849e00640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f083c010730 tx=0x7f083c010aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33274401e162618 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f082a000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c019050 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f083c0146e0 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f083c010c30 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f083c02b050 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.136+0000 7f084edf0740 10 client.4491 fetch_fsmap learned FSMap version 6 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e8104256b0 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f083c010c30 con 0x55e810721e80 2024-09-11T00:44:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f083c02e020 con 0x55e810721e80 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 10 client.4491 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 10 client.4491 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 20 client.4491 populate_metadata read hostname 'smithi081' 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e810741d50 0x55e81074d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 4 client.4491 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e81065f520 con 0x55e810741d50 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.137+0000 7f0849400640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e810741d50 0x55e81074d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.138+0000 7f0849400640 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e810741d50 0x55e81074d590 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856ba3af25e231fc server_cookie=f2f7a2047380ee29 in_seq=0 out_seq=0 2024-09-11T00:44:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:25.138+0000 7f082a000640 10 client.4491 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.385+0000 7f082a000640 1 -- 172.21.15.81:0/3193056142 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e81065f520 con 0x55e810741d50 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.385+0000 7f082a000640 10 client.4491 handle_command_reply: tid=0 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.385+0000 7f084edf0740 1 client.4491 shutdown 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 msgr2=0x55e810729050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f083c010730 tx=0x7f083c010aa0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 shutdown_connections 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e810741d50 0x55e81074d590 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e810721e80 0x55e810729050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e810715b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 --2- 172.21.15.81:0/3193056142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e81073e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f082a000640 0 client.4491 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 >> 172.21.15.81:0/3193056142 conn(0x55e8106e5550 msgr2=0x55e81071bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 shutdown_connections 2024-09-11T00:44:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 1 -- 172.21.15.81:0/3193056142 wait complete. 2024-09-11T00:44:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.386+0000 7f084edf0740 20 client.4491 trim_cache size 0 max 16384 2024-09-11T00:44:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.406+0000 7f084edf0740 1 Processor -- start 2024-09-11T00:44:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.406+0000 7f084edf0740 1 -- start start 2024-09-11T00:44:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 0x55e810715910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e81071ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e810721e80 0x55e810720510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08441f98b0 con 0x55e8106e7d70 2024-09-11T00:44:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e810720dc0 con 0x55e8106e8150 2024-09-11T00:44:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.407+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e810723260 con 0x55e810721e80 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0848a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e81071ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e810721e80 0x55e810720510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 0x55e810715910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0848a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e81071ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:41938/0 (socket says 172.21.15.81:41938) 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0848a00640 1 -- 172.21.15.81:0/4022354162 learned_addr learned my addr 172.21.15.81:0/4022354162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 -- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e810721e80 msgr2=0x55e810720510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e810721e80 0x55e810720510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 -- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 msgr2=0x55e81071ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e81071ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 -- 172.21.15.81:0/4022354162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e810723cb0 con 0x55e8106e7d70 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.408+0000 7f0849400640 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 0x55e810715910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08380991c0 tx=0x7f083806a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cd408d9d60d35c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.409+0000 7f0835200640 1 -- 172.21.15.81:0/4022354162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08380630c0 con 0x55e8106e7d70 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.409+0000 7f0835200640 1 -- 172.21.15.81:0/4022354162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0838067ba0 con 0x55e8106e7d70 2024-09-11T00:44:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.409+0000 7f0835200640 1 -- 172.21.15.81:0/4022354162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083806c5c0 con 0x55e8106e7d70 2024-09-11T00:44:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.409+0000 7f084edf0740 1 -- 172.21.15.81:0/4022354162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 msgr2=0x55e810715910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.409+0000 7f084edf0740 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 0x55e810715910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08380991c0 tx=0x7f083806a040 comp rx=0 tx=0).stop 2024-09-11T00:44:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 -- 172.21.15.81:0/4022354162 shutdown_connections 2024-09-11T00:44:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e810721e80 0x55e810720510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e8106e8150 0x55e81071ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 --2- 172.21.15.81:0/4022354162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e7d70 0x55e810715910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 -- 172.21.15.81:0/4022354162 >> 172.21.15.81:0/4022354162 conn(0x55e8106e5550 msgr2=0x55e8106e4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 -- 172.21.15.81:0/4022354162 shutdown_connections 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 -- 172.21.15.81:0/4022354162 wait complete. 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.410+0000 7f084edf0740 1 -- start start 2024-09-11T00:44:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.411+0000 7f084edf0740 1 Processor -- start 2024-09-11T00:44:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e810744c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e810721e80 0x55e8107a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e810741bd0 con 0x55e8106e8150 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e810716080 con 0x55e810721e80 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e810742220 con 0x55e8106e7d70 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f084edf0740 10 client.0 _ll_register_callbacks cb 0x7f083c0016a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55206/0 (socket says 172.21.15.81:55206) 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 -- 172.21.15.81:0/1979209756 learned_addr learned my addr 172.21.15.81:0/1979209756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 -- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 msgr2=0x55e810744c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e810744c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 -- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e810721e80 msgr2=0x55e8107a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e810721e80 0x55e8107a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.412+0000 7f0848a00640 1 -- 172.21.15.81:0/1979209756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e810748c90 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f0848a00640 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0830001690 tx=0x7f0830006b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cf5b5f2bb2ad77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f082a000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830051070 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f083004d450 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0838067ba0 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f083005c050 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f084edf0740 10 client.4497 fetch_fsmap learned FSMap version 6 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e81073e690 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.413+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0838067ba0 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f083005f020 con 0x55e8106e8150 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 10 client.4497 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 10 client.4497 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:44:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 20 client.4497 populate_metadata read hostname 'smithi081' 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e81071e500 0x55e8107bb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 4 client.4497 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "status"}) -- 0x55e8107538b0 con 0x55e81071e500 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.414+0000 7f0849400640 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e81071e500 0x55e8107bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f0849400640 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e81071e500 0x55e8107bb890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=901cf03077489ee3 server_cookie=2183722473681014 in_seq=0 out_seq=0 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f082a000640 10 client.4497 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f082a000640 1 -- 172.21.15.81:0/1979209756 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55e8107538b0 con 0x55e81071e500 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f082a000640 10 client.4497 handle_command_reply: tid=0 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f084edf0740 1 client.4497 shutdown 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 msgr2=0x55e81073ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.415+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0830001690 tx=0x7f0830006b70 comp rx=0 tx=0).stop 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 shutdown_connections 2024-09-11T00:44:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e81071e500 0x55e8107bb890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e810721e80 0x55e8107a8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e8106e8150 0x55e81073ad60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 --2- 172.21.15.81:0/1979209756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e8106e7d70 0x55e810744c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f082a000640 0 client.4497 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 >> 172.21.15.81:0/1979209756 conn(0x55e8106e5550 msgr2=0x55e8106e90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 shutdown_connections 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 1 -- 172.21.15.81:0/1979209756 wait complete. 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.416+0000 7f084edf0740 20 client.4497 trim_cache size 0 max 16384 2024-09-11T00:44:27.422 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "62a8ae86-7f85-478f-9a99-4c394aac48f1", 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4411, 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.091230830000001, 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 5, 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 27, 2024-09-11T00:44:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 27, 2024-09-11T00:44:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.111937393000002 2024-09-11T00:44:27.424 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 msgr2=0x7f082407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 0x7f082407a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0830032000 tx=0x7f0830001190 comp rx=0 tx=0).stop 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 msgr2=0x7f084414b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0838011d40 tx=0x7f083800f790 comp rx=0 tx=0).stop 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 shutdown_connections 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0824077fa0 0x7f082407a460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08441530a0 0x7f084415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f084414b810 0x7f0844154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 --2- 172.21.15.81:0/2033257704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082c004800 0x7f084414b180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 >> 172.21.15.81:0/2033257704 conn(0x7f08440700f0 msgr2=0x7f084406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 shutdown_connections 2024-09-11T00:44:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.417+0000 7f084be00640 1 -- 172.21.15.81:0/2033257704 wait complete. 2024-09-11T00:44:27.437 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:44:27.437 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:27.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 -- 172.21.15.81:0/3276935221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788003a80 msgr2=0x7f2788003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 --2- 172.21.15.81:0/3276935221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788003a80 0x7f2788003ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27940016c0 tx=0x7f2788005830 comp rx=0 tx=0).stop 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27a3e00640 1 -- 172.21.15.81:0/3276935221 reap_dead start 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 -- 172.21.15.81:0/3276935221 shutdown_connections 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 -- 172.21.15.81:0/3276935221 >> 172.21.15.81:0/3276935221 conn(0x7f27a40700f0 msgr2=0x7f27a4070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 -- 172.21.15.81:0/3276935221 shutdown_connections 2024-09-11T00:44:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.595+0000 7f27aa000640 1 -- 172.21.15.81:0/3276935221 wait complete. 2024-09-11T00:44:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.597+0000 7f27aa000640 1 Processor -- start 2024-09-11T00:44:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.597+0000 7f27aa000640 1 -- start start 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2788003a80 0x7f27a41f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a41e5480 0x7f27a41e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a415a610 con 0x7f27a414f590 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4073250 con 0x7f27a41e5480 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27aa000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27a415a790 con 0x7f2788003a80 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55222/0 (socket says 172.21.15.81:55222) 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 -- 172.21.15.81:0/2596611495 learned_addr learned my addr 172.21.15.81:0/2596611495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a3e00640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a41e5480 0x7f27a41e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a3400640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2788003a80 0x7f27a41f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 -- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2788003a80 msgr2=0x7f27a41f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2788003a80 0x7f27a41f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 -- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a41e5480 msgr2=0x7f27a41e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a41e5480 0x7f27a41e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.598+0000 7f27a2a00640 1 -- 172.21.15.81:0/2596611495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a40aef20 con 0x7f27a414f590 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f27a2a00640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f279000e6a0 tx=0x7f279000eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790015070 con 0x7f27a414f590 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279000cad0 con 0x7f27a414f590 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279000eea0 con 0x7f27a414f590 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a40af200 con 0x7f27a414f590 2024-09-11T00:44:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.599+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a40af7c0 con 0x7f27a414f590 2024-09-11T00:44:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.600+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a40740b0 con 0x7f27a414f590 2024-09-11T00:44:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.601+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2790011460 con 0x7f27a414f590 2024-09-11T00:44:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.602+0000 7f279b400640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 0x7f278407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.602+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f279009a760 con 0x7f27a414f590 2024-09-11T00:44:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.602+0000 7f27a3400640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 0x7f278407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.603+0000 7f27a3400640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 0x7f278407a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2794032000 tx=0x7f2794001190 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.606+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f27900627a0 con 0x7f27a414f590 2024-09-11T00:44:27.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.826+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27a40c24e0 con 0x7f27a414f590 2024-09-11T00:44:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.826+0000 7f279b400640 1 -- 172.21.15.81:0/2596611495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f27900671d0 con 0x7f27a414f590 2024-09-11T00:44:27.829 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 msgr2=0x7f278407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 0x7f278407a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2794032000 tx=0x7f2794001190 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 msgr2=0x7f27a40b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f279000e6a0 tx=0x7f279000eb60 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 shutdown_connections 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077f70 0x7f278407a430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a41e5480 0x7f27a41e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a414f590 0x7f27a40b0850 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 --2- 172.21.15.81:0/2596611495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2788003a80 0x7f27a41f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 >> 172.21.15.81:0/2596611495 conn(0x7f27a40700f0 msgr2=0x7f27a4072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 shutdown_connections 2024-09-11T00:44:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:27.828+0000 7f27aa000640 1 -- 172.21.15.81:0/2596611495 wait complete. 2024-09-11T00:44:27.847 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T00:44:27.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:44:27.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-11T00:44:27.847 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T00:44:27.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:27.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T00:44:27.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:44:27.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:44:27.848 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T00:44:27.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:27.848 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-11T00:44:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42664sec preferred_lft 42664sec 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-11T00:44:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:27.887 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:44:27.887 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:28.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:28.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:28.303 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:44:28.358 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-11T00:44:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:28.362 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-11T00:44:28.421 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-11T00:44:28.422 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:44:28.422 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:44:28.422 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:44:28.422 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:44:28.422 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:28.422 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:28.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:44:28.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:44:28.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:44:28.423 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:28.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:28.997 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-11T00:44:29.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:29.032 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-11T00:44:29.107 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:29.107 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:29.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:29.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T00:44:29.108 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:29.282 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T00:44:29.283 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:29.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:29.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:29.518 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:29.519 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:29.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-11T00:44:29.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:44:29.519 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:29.685 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T00:44:29.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:44:29.685 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:29.720 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T00:44:29.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:44:29.720 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:29.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-11T00:44:29.893 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:44:29.929 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-11T00:44:29.929 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-11T00:44:29.929 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-11T00:44:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:44:29.931 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-11T00:44:29.932 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:29.932 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:29.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:29.933 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-11T00:44:30.008 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:44:30.008 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T00:44:30.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-11T00:44:30.108 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:44:30.144 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-11T00:44:30.144 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-11T00:44:30.144 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-11T00:44:30.144 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-11T00:44:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:30.146 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:30.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:30.147 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-11T00:44:30.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-11T00:44:30.222+0000 7f4d6925a480 -1 init, newargv = 0x5572b3d34e60 newargc=15 2024-09-11T00:44:30.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42252]: starting ceph client 2024-09-11T00:44:30.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42252]: starting fuse 2024-09-11T00:44:31.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-11T00:44:31.391 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:44:31.428 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:44:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:44:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:44:31.431 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:44:31.431 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-11T00:44:31.431 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:31.431 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:31.431 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:31.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:31.432 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-11T00:44:31.508 INFO:teuthology.orchestra.run.smithi081.stdout:43 2024-09-11T00:44:31.508 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-11T00:44:31.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-11T00:44:31.509 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-11T00:44:31.510 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-11T00:44:31.669 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.42252.asok 2024-09-11T00:44:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:31.683 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42252.asok 2024-09-11T00:44:31.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:31.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42252.asok status 2024-09-11T00:44:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:44:31.865 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "42252", 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4512, 2024-09-11T00:44:31.866 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4512 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 988924029 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-11T00:44:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 988924029 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4512 192.168.0.1:0/988924029", 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/988924029", 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 5, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 27, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-11T00:44:31.868 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:44:31.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:31.877 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-11T00:44:31.877 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:31.913 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-11T00:44:31.913 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:31.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:31.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:32.010 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T00:44:32.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:44:32.116 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-11T00:44:32.116 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T00:44:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:32.124 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:44:32.124 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:44:32.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:44:32.310 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-09-11T00:44:32.309+0000 7fc4c9a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 -- 172.21.15.81:0/4079318904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 msgr2=0x7f6f700c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 --2- 172.21.15.81:0/4079318904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f700c8330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6f700b1fd0 tx=0x7f6f6802a940 comp rx=0 tx=0).stop 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 -- 172.21.15.81:0/4079318904 shutdown_connections 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 --2- 172.21.15.81:0/4079318904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f700c8330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 --2- 172.21.15.81:0/4079318904 >> v2:172.21.15.167:3300/0 conn(0x7f6f700c6fa0 0x7f6f7015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 -- 172.21.15.81:0/4079318904 >> 172.21.15.81:0/4079318904 conn(0x7f6f7006ffd0 msgr2=0x7f6f700703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 -- 172.21.15.81:0/4079318904 shutdown_connections 2024-09-11T00:44:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.356+0000 7f6f76400640 1 -- 172.21.15.81:0/4079318904 wait complete. 2024-09-11T00:44:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.358+0000 7f6f76400640 1 Processor -- start 2024-09-11T00:44:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.358+0000 7f6f76400640 1 -- start start 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 0x7f6f70157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 0x7f6f70151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f700c7e10 con 0x7f6f700c0eb0 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7015e850 con 0x7f6f700c6fa0 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.359+0000 7f6f76400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7015d9e0 con 0x7f6f700c6bc0 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55244/0 (socket says 172.21.15.81:55244) 2024-09-11T00:44:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 -- 172.21.15.81:0/1655255770 learned_addr learned my addr 172.21.15.81:0/1655255770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f6fe00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 0x7f6f70157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75a00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 0x7f6f70151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 -- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 msgr2=0x7f6f70157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 0x7f6f70157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 -- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 msgr2=0x7f6f70151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 0x7f6f70151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 -- 172.21.15.81:0/1655255770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700c36a0 con 0x7f6f700c0eb0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f6fe00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 0x7f6f70157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75a00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 0x7f6f70151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.360+0000 7f6f75000640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c500 tx=0x7f6f6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.361+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64016020 con 0x7f6f700c0eb0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.361+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f64012920 con 0x7f6f700c0eb0 2024-09-11T00:44:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.361+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f700c3cb0 con 0x7f6f700c0eb0 2024-09-11T00:44:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.361+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64012d30 con 0x7f6f700c0eb0 2024-09-11T00:44:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.361+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f700c5b00 con 0x7f6f700c0eb0 2024-09-11T00:44:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.362+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f70154b70 con 0x7f6f700c0eb0 2024-09-11T00:44:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.363+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6f6401a3b0 con 0x7f6f700c0eb0 2024-09-11T00:44:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.364+0000 7f6f6cc00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 0x7f6f5007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.364+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6f64099fe0 con 0x7f6f700c0eb0 2024-09-11T00:44:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.365+0000 7f6f6fe00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 0x7f6f5007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.365+0000 7f6f6fe00640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 0x7f6f5007a460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f701e6a20 tx=0x7f6f5c005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.368+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6f64020030 con 0x7f6f700c0eb0 2024-09-11T00:44:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.563+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6f70156eb0 con 0x7f6f700c0eb0 2024-09-11T00:44:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.563+0000 7f6f6cc00640 1 -- 172.21.15.81:0/1655255770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6f64062850 con 0x7f6f700c0eb0 2024-09-11T00:44:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-11T00:44:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 msgr2=0x7f6f5007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 0x7f6f5007a460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f701e6a20 tx=0x7f6f5c005f90 comp rx=0 tx=0).stop 2024-09-11T00:44:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 msgr2=0x7f6f7014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c500 tx=0x7f6f6400c9c0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 shutdown_connections 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6f50077fa0 0x7f6f5007a460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f700c6fa0 0x7f6f70151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f700c6bc0 0x7f6f70157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 --2- 172.21.15.81:0/1655255770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f700c0eb0 0x7f6f7014aa70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 >> 172.21.15.81:0/1655255770 conn(0x7f6f7006ffd0 msgr2=0x7f6f70153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 shutdown_connections 2024-09-11T00:44:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.566+0000 7f6f76400640 1 -- 172.21.15.81:0/1655255770 wait complete. 2024-09-11T00:44:32.584 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:44:32.584 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:44:32.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 -- 172.21.15.81:0/1320198179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 msgr2=0x7f5ea0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/1320198179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ea0004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc071d80 tx=0x7f5ea0005830 comp rx=0 tx=0).stop 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ebb400640 1 -- 172.21.15.81:0/1320198179 reap_dead start 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 -- 172.21.15.81:0/1320198179 shutdown_connections 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 -- 172.21.15.81:0/1320198179 >> 172.21.15.81:0/1320198179 conn(0x7f5ebc0700f0 msgr2=0x7f5ebc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 -- 172.21.15.81:0/1320198179 shutdown_connections 2024-09-11T00:44:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.815+0000 7f5ec1e00640 1 -- 172.21.15.81:0/1320198179 wait complete. 2024-09-11T00:44:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.817+0000 7f5ec1e00640 1 Processor -- start 2024-09-11T00:44:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.817+0000 7f5ec1e00640 1 -- start start 2024-09-11T00:44:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc1595f0 0x7f5ebc0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc0c5ed0 0x7f5ebc0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc070cf0 con 0x7f5ea0004800 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc15c140 con 0x7f5ebc1595f0 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ec1e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ebc0c16a0 con 0x7f5ebc0c5ed0 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55260/0 (socket says 172.21.15.81:55260) 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 -- 172.21.15.81:0/3358727194 learned_addr learned my addr 172.21.15.81:0/3358727194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 -- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc0c5ed0 msgr2=0x7f5ebc0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc0c5ed0 0x7f5ebc0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 -- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc1595f0 msgr2=0x7f5ebc0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc1595f0 0x7f5ebc0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.818+0000 7f5ebaa00640 1 -- 172.21.15.81:0/3358727194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc0af6a0 con 0x7f5ea0004800 2024-09-11T00:44:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5ebaa00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5eac003fb0 tx=0x7f5eac0064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00f860 con 0x7f5ea0004800 2024-09-11T00:44:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eac016020 con 0x7f5ea0004800 2024-09-11T00:44:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc0b0f40 con 0x7f5ea0004800 2024-09-11T00:44:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00fc40 con 0x7f5ea0004800 2024-09-11T00:44:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.819+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc0afc40 con 0x7f5ea0004800 2024-09-11T00:44:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.820+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc06def0 con 0x7f5ea0004800 2024-09-11T00:44:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.821+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5eac011430 con 0x7f5ea0004800 2024-09-11T00:44:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.823+0000 7f5eb3400640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 0x7f5e9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.823+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5eac09acf0 con 0x7f5ea0004800 2024-09-11T00:44:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.823+0000 7f5eba000640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 0x7f5e9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.824+0000 7f5eba000640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 0x7f5e9c07a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc071d80 tx=0x7f5ea8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:32.827+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ebc06def0 con 0x7f5ea0004800 2024-09-11T00:44:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.021+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ebc152ad0 con 0x7f5ea0004800 2024-09-11T00:44:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.021+0000 7f5eb3400640 1 -- 172.21.15.81:0/3358727194 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5eac020020 con 0x7f5ea0004800 2024-09-11T00:44:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 msgr2=0x7f5e9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 0x7f5e9c07a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc071d80 tx=0x7f5ea8004730 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 msgr2=0x7f5ebc0aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5eac003fb0 tx=0x7f5eac0064f0 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 shutdown_connections 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5e9c077f70 0x7f5e9c07a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ebc0c5ed0 0x7f5ebc0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ebc1595f0 0x7f5ebc0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 --2- 172.21.15.81:0/3358727194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea0004800 0x7f5ebc0aec50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 >> 172.21.15.81:0/3358727194 conn(0x7f5ebc0700f0 msgr2=0x7f5ebc06f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 shutdown_connections 2024-09-11T00:44:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:33.024+0000 7f5ec1e00640 1 -- 172.21.15.81:0/3358727194 wait complete. 2024-09-11T00:44:33.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-11T00:44:33.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:33.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T00:44:33.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42252]: fuse finished with error 0 and tester_r 0 2024-09-11T00:44:33.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:44:39.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T00:44:39.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:39.202 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T00:44:39.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 -- 172.21.15.81:0/186512250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c901513b0 msgr2=0x7f1c90151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 --2- 172.21.15.81:0/186512250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c901513b0 0x7f1c90151790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c900cbf10 tx=0x7f1c8002a5f0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 -- 172.21.15.81:0/186512250 shutdown_connections 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 --2- 172.21.15.81:0/186512250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90072650 0x7f1c90072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 --2- 172.21.15.81:0/186512250 >> v2:172.21.15.167:3300/0 conn(0x7f1c90157b30 0x7f1c90157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 --2- 172.21.15.81:0/186512250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c901513b0 0x7f1c90151790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 -- 172.21.15.81:0/186512250 >> 172.21.15.81:0/186512250 conn(0x7f1c900700f0 msgr2=0x7f1c90070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 -- 172.21.15.81:0/186512250 shutdown_connections 2024-09-11T00:44:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.452+0000 7f1c96200640 1 -- 172.21.15.81:0/186512250 wait complete. 2024-09-11T00:44:39.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.453+0000 7f1c96200640 1 Processor -- start 2024-09-11T00:44:39.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.454+0000 7f1c96200640 1 -- start start 2024-09-11T00:44:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.454+0000 7f1c96200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c96200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c901513b0 0x7f1c90159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c96200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90157b30 0x7f1c9014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c96200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9006ebd0 con 0x7f1c90072650 2024-09-11T00:44:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c96200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c900c83a0 con 0x7f1c901513b0 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c96200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9006f5e0 con 0x7f1c90157b30 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38790/0 (socket says 172.21.15.81:38790) 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 -- 172.21.15.81:0/2670095156 learned_addr learned my addr 172.21.15.81:0/2670095156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8ea00640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c901513b0 0x7f1c90159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8fe00640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90157b30 0x7f1c9014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 -- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90157b30 msgr2=0x7f1c9014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90157b30 0x7f1c9014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 -- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c901513b0 msgr2=0x7f1c90159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c901513b0 0x7f1c90159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 -- 172.21.15.81:0/2670095156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c90161910 con 0x7f1c90072650 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.455+0000 7f1c8f400640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c80034040 tx=0x7f1c800039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.456+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8003e030 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.456+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c800047a0 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.456+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9014cb50 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.456+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80035040 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.456+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c90162200 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.457+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90070c10 con 0x7f1c90072650 2024-09-11T00:44:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.458+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1c80004b70 con 0x7f1c90072650 2024-09-11T00:44:39.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.459+0000 7f1c87400640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 0x7f1c7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.459+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1c800bab80 con 0x7f1c90072650 2024-09-11T00:44:39.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.459+0000 7f1c8ea00640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 0x7f1c7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.460+0000 7f1c8ea00640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 0x7f1c7007a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c009110 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:39.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.463+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1c80083210 con 0x7f1c90072650 2024-09-11T00:44:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.650+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c9006e8a0 con 0x7f1c90072650 2024-09-11T00:44:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.651+0000 7f1c87400640 1 -- 172.21.15.81:0/2670095156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f1c80082b10 con 0x7f1c90072650 2024-09-11T00:44:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:39.654 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:39.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 msgr2=0x7f1c7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 0x7f1c7007a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c009110 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 msgr2=0x7f1c9014bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c80034040 tx=0x7f1c800039e0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 shutdown_connections 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1c70077f70 0x7f1c7007a430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c90157b30 0x7f1c9014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c901513b0 0x7f1c90159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 --2- 172.21.15.81:0/2670095156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90072650 0x7f1c9014bf50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 >> 172.21.15.81:0/2670095156 conn(0x7f1c900700f0 msgr2=0x7f1c900c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 shutdown_connections 2024-09-11T00:44:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.654+0000 7f1c96200640 1 -- 172.21.15.81:0/2670095156 wait complete. 2024-09-11T00:44:39.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 -- 172.21.15.81:0/134876570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 msgr2=0x7fd5000c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 --2- 172.21.15.81:0/134876570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000c8a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009830 tx=0x7fd4f002a510 comp rx=0 tx=0).stop 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 -- 172.21.15.81:0/134876570 shutdown_connections 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 --2- 172.21.15.81:0/134876570 >> v2:172.21.15.167:3300/0 conn(0x7fd50015b880 0x7fd5000c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 --2- 172.21.15.81:0/134876570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000c8a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 -- 172.21.15.81:0/134876570 >> 172.21.15.81:0/134876570 conn(0x7fd5000ca9b0 msgr2=0x7fd5000cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 -- 172.21.15.81:0/134876570 shutdown_connections 2024-09-11T00:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.826+0000 7fd4ff200640 1 -- 172.21.15.81:0/134876570 wait complete. 2024-09-11T00:44:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.827+0000 7fd4ff200640 1 Processor -- start 2024-09-11T00:44:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 -- start start 2024-09-11T00:44:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5000c3110 0x7fd5001f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd500158290 con 0x7fd50015b880 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd500159140 con 0x7fd5000c3110 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.828+0000 7fd4ff200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd5000cb4d0 con 0x7fd500152780 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38798/0 (socket says 172.21.15.81:38798) 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 -- 172.21.15.81:0/2906370757 learned_addr learned my addr 172.21.15.81:0/2906370757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fde00640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5000c3110 0x7fd5001f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fd400640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 -- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 msgr2=0x7fd5000aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 -- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5000c3110 msgr2=0x7fd5001f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5000c3110 0x7fd5001f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 -- 172.21.15.81:0/2906370757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50006db90 con 0x7fd50015b880 2024-09-11T00:44:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.829+0000 7fd4fe800640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800cbc0 tx=0x7fd4f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.830+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8016020 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.830+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4f800ae30 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.830+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50006de70 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.830+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8012680 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.830+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50006e430 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.831+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd500076620 con 0x7fd50015b880 2024-09-11T00:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.832+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd4f801b400 con 0x7fd50015b880 2024-09-11T00:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.833+0000 7fd4f6000640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 0x7fd4e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.834+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd4f809ab70 con 0x7fd50015b880 2024-09-11T00:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.834+0000 7fd4fde00640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 0x7fd4e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.834+0000 7fd4fde00640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 0x7fd4e007a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0034000 tx=0x7fd4f0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:39.838+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd4f8020020 con 0x7fd50015b880 2024-09-11T00:44:40.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.022+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5000b3a00 con 0x7fd50015b880 2024-09-11T00:44:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.023+0000 7fd4f6000640 1 -- 172.21.15.81:0/2906370757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fd5000c9580 con 0x7fd50015b880 2024-09-11T00:44:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:40.026 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:40.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 msgr2=0x7fd4e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:40.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 0x7fd4e007a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0034000 tx=0x7fd4f0004730 comp rx=0 tx=0).stop 2024-09-11T00:44:40.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 msgr2=0x7fd50006ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:40.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800cbc0 tx=0x7fd4f800a430 comp rx=0 tx=0).stop 2024-09-11T00:44:40.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 shutdown_connections 2024-09-11T00:44:40.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd4e0077f70 0x7fd4e007a430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd50015b880 0x7fd50006ef10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd500152780 0x7fd5000aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 --2- 172.21.15.81:0/2906370757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5000c3110 0x7fd5001f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.025+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 >> 172.21.15.81:0/2906370757 conn(0x7fd5000ca9b0 msgr2=0x7fd5000c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.026+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 shutdown_connections 2024-09-11T00:44:40.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.026+0000 7fd4ff200640 1 -- 172.21.15.81:0/2906370757 wait complete. 2024-09-11T00:44:40.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 -- 172.21.15.81:0/1201512063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 msgr2=0x7f9838073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 --2- 172.21.15.81:0/1201512063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f9838073870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9824009830 tx=0x7f982402a510 comp rx=0 tx=0).stop 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 -- 172.21.15.81:0/1201512063 shutdown_connections 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 --2- 172.21.15.81:0/1201512063 >> v2:172.21.15.167:3300/0 conn(0x7f983806f6b0 0x7f9838073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 --2- 172.21.15.81:0/1201512063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f9838073870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 -- 172.21.15.81:0/1201512063 >> 172.21.15.81:0/1201512063 conn(0x7f983806ff90 msgr2=0x7f98380703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 -- 172.21.15.81:0/1201512063 shutdown_connections 2024-09-11T00:44:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.203+0000 7f983ea00640 1 -- 172.21.15.81:0/1201512063 wait complete. 2024-09-11T00:44:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.205+0000 7f983ea00640 1 Processor -- start 2024-09-11T00:44:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.205+0000 7f983ea00640 1 -- start start 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f983806f6b0 0x7f98381e2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f98381f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98380c0eb0 con 0x7f98381515c0 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9838157f40 con 0x7f983806f6b0 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f98381519a0 con 0x7f9838074c20 2024-09-11T00:44:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38806/0 (socket says 172.21.15.81:38806) 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f983ca00640 1 -- 172.21.15.81:0/2089766627 learned_addr learned my addr 172.21.15.81:0/2089766627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f9837e00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f983806f6b0 0x7f98381e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.206+0000 7f9837400640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f98381f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 -- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 msgr2=0x7f98381f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f98381f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 -- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f983806f6b0 msgr2=0x7f98381e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f983806f6b0 0x7f98381e2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 -- 172.21.15.81:0/2089766627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838149740 con 0x7f98381515c0 2024-09-11T00:44:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ca00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f983000e930 tx=0x7f983000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000cd80 con 0x7f98381515c0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9830004020 con 0x7f98381515c0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830004470 con 0x7f98381515c0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98381e2b20 con 0x7f98381515c0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.207+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98381499b0 con 0x7f98381515c0 2024-09-11T00:44:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.208+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983806a350 con 0x7f98381515c0 2024-09-11T00:44:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.210+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f98300035f0 con 0x7f98381515c0 2024-09-11T00:44:40.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.211+0000 7f982fe00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 0x7f981807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:40.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.211+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f983009aa50 con 0x7f98381515c0 2024-09-11T00:44:40.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.211+0000 7f9837e00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 0x7f981807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:40.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.212+0000 7f9837e00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 0x7f981807a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98280017a0 tx=0x7f9828001730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:40.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.215+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f983806a350 con 0x7f98381515c0 2024-09-11T00:44:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:40.442+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f983806dbd0 con 0x7f98381515c0 2024-09-11T00:44:41.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.417+0000 7f982fe00640 1 -- 172.21.15.81:0/2089766627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f9830062b50 con 0x7f98381515c0 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 msgr2=0x7f981807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 0x7f981807a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98280017a0 tx=0x7f9828001730 comp rx=0 tx=0).stop 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 msgr2=0x7f98381e1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f983000e930 tx=0x7f983000edf0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 shutdown_connections 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9818077f70 0x7f981807a430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381515c0 0x7f98381e1b70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9838074c20 0x7f98381f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 --2- 172.21.15.81:0/2089766627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f983806f6b0 0x7f98381e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.420+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 >> 172.21.15.81:0/2089766627 conn(0x7f983806ff90 msgr2=0x7f983814e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:41.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.421+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 shutdown_connections 2024-09-11T00:44:41.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.421+0000 7f983ea00640 1 -- 172.21.15.81:0/2089766627 wait complete. 2024-09-11T00:44:41.439 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300} 2024-09-11T00:44:41.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T00:44:41.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:41.529 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:44:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 -- 172.21.15.81:0/24138055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37280cd0c0 msgr2=0x7f3728162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 --2- 172.21.15.81:0/24138055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37280cd0c0 0x7f3728162a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3720009860 tx=0x7f372002a510 comp rx=0 tx=0).stop 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 -- 172.21.15.81:0/24138055 shutdown_connections 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 --2- 172.21.15.81:0/24138055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37280cd0c0 0x7f3728162a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 -- 172.21.15.81:0/24138055 >> 172.21.15.81:0/24138055 conn(0x7f37280cc480 msgr2=0x7f37280cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 -- 172.21.15.81:0/24138055 shutdown_connections 2024-09-11T00:44:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.602+0000 7f372de00640 1 -- 172.21.15.81:0/24138055 wait complete. 2024-09-11T00:44:41.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.603+0000 7f372de00640 1 Processor -- start 2024-09-11T00:44:41.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 -- start start 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3728068c60 0x7f37281ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37281516d0 0x7f3728074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37280c5a50 con 0x7f37280cd0c0 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3728072d30 con 0x7f3728068c60 2024-09-11T00:44:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.604+0000 7f372de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37280c5f80 con 0x7f37281516d0 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38816/0 (socket says 172.21.15.81:38816) 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 -- 172.21.15.81:0/149961170 learned_addr learned my addr 172.21.15.81:0/149961170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f372d400640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37281516d0 0x7f3728074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f372ca00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3728068c60 0x7f37281ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 -- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37281516d0 msgr2=0x7f3728074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37281516d0 0x7f3728074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 -- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3728068c60 msgr2=0x7f37281ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3728068c60 0x7f37281ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 -- 172.21.15.81:0/149961170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37281420a0 con 0x7f37280cd0c0 2024-09-11T00:44:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.605+0000 7f3727e00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f371400c500 tx=0x7f371400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.606+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714017070 con 0x7f37280cd0c0 2024-09-11T00:44:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.606+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37140035f0 con 0x7f37280cd0c0 2024-09-11T00:44:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.606+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714003a40 con 0x7f37280cd0c0 2024-09-11T00:44:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.606+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37281eea40 con 0x7f37280cd0c0 2024-09-11T00:44:41.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.606+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281eece0 con 0x7f37280cd0c0 2024-09-11T00:44:41.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.607+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37280c3980 con 0x7f37280cd0c0 2024-09-11T00:44:41.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.608+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3714003be0 con 0x7f37280cd0c0 2024-09-11T00:44:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.609+0000 7f3724c00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 0x7f370807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.609+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3714099840 con 0x7f37280cd0c0 2024-09-11T00:44:41.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.609+0000 7f372ca00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 0x7f370807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.610+0000 7f372ca00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 0x7f370807a460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3718001be0 tx=0x7f3718009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.614+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f37140619c0 con 0x7f37280cd0c0 2024-09-11T00:44:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:41.836+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3728141e80 con 0x7f37280cd0c0 2024-09-11T00:44:42.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.426+0000 7f3724c00640 1 -- 172.21.15.81:0/149961170 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f37140663f0 con 0x7f37280cd0c0 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.428+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 msgr2=0x7f370807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.428+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 0x7f370807a460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3718001be0 tx=0x7f3718009040 comp rx=0 tx=0).stop 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.428+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 msgr2=0x7f37281f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.428+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f371400c500 tx=0x7f371400c9c0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 shutdown_connections 2024-09-11T00:44:42.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3708077fa0 0x7f370807a460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37281516d0 0x7f3728074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37280cd0c0 0x7f37281f1ee0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 --2- 172.21.15.81:0/149961170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3728068c60 0x7f37281ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 >> 172.21.15.81:0/149961170 conn(0x7f37280cc480 msgr2=0x7f372814f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 shutdown_connections 2024-09-11T00:44:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.429+0000 7f372de00640 1 -- 172.21.15.81:0/149961170 wait complete. 2024-09-11T00:44:42.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-11T00:44:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 -- 172.21.15.81:0/2944121308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0900ccff0 msgr2=0x7fe0900cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2944121308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0900ccff0 0x7fe0900cd440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe088005fd0 tx=0x7fe08802a670 comp rx=0 tx=0).stop 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 -- 172.21.15.81:0/2944121308 shutdown_connections 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2944121308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe09015daf0 0x7fe0900cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2944121308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0900ccff0 0x7fe0900cd440 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 -- 172.21.15.81:0/2944121308 >> 172.21.15.81:0/2944121308 conn(0x7fe090068d00 msgr2=0x7fe090069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 -- 172.21.15.81:0/2944121308 shutdown_connections 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.648+0000 7fe08fe00640 1 -- 172.21.15.81:0/2944121308 wait complete. 2024-09-11T00:44:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.649+0000 7fe08fe00640 1 Processor -- start 2024-09-11T00:44:42.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.649+0000 7fe08fe00640 1 -- start start 2024-09-11T00:44:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 0x7fe090156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0900ccff0 0x7fe090157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe09006d070 con 0x7fe09015daf0 2024-09-11T00:44:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe09006cd90 con 0x7fe0900c9ca0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.650+0000 7fe08fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0900cc6a0 con 0x7fe0900ccff0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38826/0 (socket says 172.21.15.81:38826) 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 -- 172.21.15.81:0/2579007852 learned_addr learned my addr 172.21.15.81:0/2579007852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08e000640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0900ccff0 0x7fe090157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08ea00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 0x7fe090156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 -- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0900ccff0 msgr2=0x7fe090157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0900ccff0 0x7fe090157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 -- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 msgr2=0x7fe090156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 0x7fe090156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 -- 172.21.15.81:0/2579007852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09014ea00 con 0x7fe09015daf0 2024-09-11T00:44:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08ea00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 0x7fe090156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.651+0000 7fe08f400640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe088009230 tx=0x7fe088003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.652+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08803f070 con 0x7fe09015daf0 2024-09-11T00:44:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.652+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0880047a0 con 0x7fe09015daf0 2024-09-11T00:44:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.652+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088035030 con 0x7fe09015daf0 2024-09-11T00:44:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.652+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09014ece0 con 0x7fe09015daf0 2024-09-11T00:44:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.652+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09014f2a0 con 0x7fe09015daf0 2024-09-11T00:44:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.653+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09014f4e0 con 0x7fe09015daf0 2024-09-11T00:44:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.654+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe088004bf0 con 0x7fe09015daf0 2024-09-11T00:44:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.655+0000 7fe087400640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 0x7fe07007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.655+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe0880bb0e0 con 0x7fe09015daf0 2024-09-11T00:44:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.656+0000 7fe08ea00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 0x7fe07007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.656+0000 7fe08ea00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 0x7fe07007a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe080007fd0 tx=0x7fe080009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.659+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0880831b0 con 0x7fe09015daf0 2024-09-11T00:44:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:42.881+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe0900ca080 con 0x7fe09015daf0 2024-09-11T00:44:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.433+0000 7fe087400640 1 -- 172.21.15.81:0/2579007852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fe088087be0 con 0x7fe09015daf0 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 msgr2=0x7fe07007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 0x7fe07007a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe080007fd0 tx=0x7fe080009040 comp rx=0 tx=0).stop 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 msgr2=0x7fe0901f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe088009230 tx=0x7fe088003820 comp rx=0 tx=0).stop 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 shutdown_connections 2024-09-11T00:44:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe070077f70 0x7fe07007a430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe09015daf0 0x7fe0901f4770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0900ccff0 0x7fe090157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 --2- 172.21.15.81:0/2579007852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0900c9ca0 0x7fe090156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 >> 172.21.15.81:0/2579007852 conn(0x7fe090068d00 msgr2=0x7fe090153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 shutdown_connections 2024-09-11T00:44:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.436+0000 7fe08fe00640 1 -- 172.21.15.81:0/2579007852 wait complete. 2024-09-11T00:44:43.454 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T00:44:43.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 -- 172.21.15.81:0/3512088800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 msgr2=0x7f15d0003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 --2- 172.21.15.81:0/3512088800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15d0003ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c310 tx=0x7f15d0005830 comp rx=0 tx=0).stop 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 -- 172.21.15.81:0/3512088800 shutdown_connections 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 --2- 172.21.15.81:0/3512088800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15d0003ee0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 -- 172.21.15.81:0/3512088800 >> 172.21.15.81:0/3512088800 conn(0x7f15ec06f1f0 msgr2=0x7f15ec06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 -- 172.21.15.81:0/3512088800 shutdown_connections 2024-09-11T00:44:43.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.609+0000 7f15f2000640 1 -- 172.21.15.81:0/3512088800 wait complete. 2024-09-11T00:44:43.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.610+0000 7f15f2000640 1 Processor -- start 2024-09-11T00:44:43.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 -- start start 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 0x7f15ec153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 0x7f15ec14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec0c9700 con 0x7f15d0003ac0 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15ec06d7b0 con 0x7f15ec0cc0d0 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.611+0000 7f15f2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f15ec06c9e0 con 0x7f15ec153d90 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38836/0 (socket says 172.21.15.81:38836) 2024-09-11T00:44:43.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 -- 172.21.15.81:0/1649129324 learned_addr learned my addr 172.21.15.81:0/1649129324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f1600640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 0x7f15ec14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15ebe00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 0x7f15ec153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 -- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 msgr2=0x7f15ec14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 0x7f15ec14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 -- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 msgr2=0x7f15ec153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 0x7f15ec153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 -- 172.21.15.81:0/1649129324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec154210 con 0x7f15d0003ac0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f1600640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 0x7f15ec14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15ebe00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 0x7f15ec153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.612+0000 7f15f0c00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15dc031040 tx=0x7f15dc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.613+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc006c70 con 0x7f15d0003ac0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.613+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15dc037450 con 0x7f15d0003ac0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.613+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ec156940 con 0x7f15d0003ac0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.613+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc001cf0 con 0x7f15d0003ac0 2024-09-11T00:44:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.613+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ec156be0 con 0x7f15d0003ac0 2024-09-11T00:44:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.614+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ec0714f0 con 0x7f15d0003ac0 2024-09-11T00:44:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.615+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f15dc04a070 con 0x7f15d0003ac0 2024-09-11T00:44:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.616+0000 7f15e8c00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 0x7f15cc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.616+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f15dc0bab70 con 0x7f15d0003ac0 2024-09-11T00:44:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.616+0000 7f15ebe00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 0x7f15cc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.617+0000 7f15ebe00640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 0x7f15cc07a460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0c9d60 tx=0x7f15d8006b80 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:43.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.619+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f15dc047060 con 0x7f15d0003ac0 2024-09-11T00:44:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.839+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15ec0c20d0 con 0x7f15d0003ac0 2024-09-11T00:44:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.840+0000 7f15e8c00640 1 -- 172.21.15.81:0/1649129324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f15ec154210 con 0x7f15d0003ac0 2024-09-11T00:44:43.842 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:43.842 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 msgr2=0x7f15cc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 0x7f15cc07a460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0c9d60 tx=0x7f15d8006b80 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 msgr2=0x7f15ec155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15dc031040 tx=0x7f15dc003d00 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 shutdown_connections 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f15cc077fa0 0x7f15cc07a460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15ec153d90 0x7f15ec14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15ec0cc0d0 0x7f15ec153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 --2- 172.21.15.81:0/1649129324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15d0003ac0 0x7f15ec155fc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 >> 172.21.15.81:0/1649129324 conn(0x7f15ec06f1f0 msgr2=0x7f15ec06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 shutdown_connections 2024-09-11T00:44:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:43.842+0000 7f15f2000640 1 -- 172.21.15.81:0/1649129324 wait complete. 2024-09-11T00:44:43.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 -- 172.21.15.81:0/21535510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a81520a0 msgr2=0x7fb9a80ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 --2- 172.21.15.81:0/21535510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a81520a0 0x7fb9a80ca1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8152a60 tx=0x7fb99802a5f0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 -- 172.21.15.81:0/21535510 shutdown_connections 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 --2- 172.21.15.81:0/21535510 >> v2:172.21.15.167:3300/0 conn(0x7fb9a80c3880 0x7fb9a80c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 --2- 172.21.15.81:0/21535510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a81520a0 0x7fb9a80ca1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 -- 172.21.15.81:0/21535510 >> 172.21.15.81:0/21535510 conn(0x7fb9a806c9e0 msgr2=0x7fb9a806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 -- 172.21.15.81:0/21535510 shutdown_connections 2024-09-11T00:44:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.014+0000 7fb9a7200640 1 -- 172.21.15.81:0/21535510 wait complete. 2024-09-11T00:44:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.016+0000 7fb9a7200640 1 Processor -- start 2024-09-11T00:44:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.016+0000 7fb9a7200640 1 -- start start 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a80c3880 0x7fb9a80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9a81520a0 0x7fb9a81f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8158950 con 0x7fb9a8152480 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8158670 con 0x7fb9a80c3880 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a80ca6e0 con 0x7fb9a81520a0 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60258/0 (socket says 172.21.15.81:60258) 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a6800640 1 -- 172.21.15.81:0/465099951 learned_addr learned my addr 172.21.15.81:0/465099951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a5e00640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a80c3880 0x7fb9a80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.017+0000 7fb9a5400640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9a81520a0 0x7fb9a81f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 -- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9a81520a0 msgr2=0x7fb9a81f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9a81520a0 0x7fb9a81f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 -- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a80c3880 msgr2=0x7fb9a80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a80c3880 0x7fb9a80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 -- 172.21.15.81:0/465099951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a814fae0 con 0x7fb9a8152480 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a6800640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000ead0 tx=0x7fb9a000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000cde0 con 0x7fb9a8152480 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9a0004c10 con 0x7fb9a8152480 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0005020 con 0x7fb9a8152480 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a815ab00 con 0x7fb9a8152480 2024-09-11T00:44:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.018+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a81f3c40 con 0x7fb9a8152480 2024-09-11T00:44:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.019+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a81f3a70 con 0x7fb9a8152480 2024-09-11T00:44:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.020+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb9a000f040 con 0x7fb9a8152480 2024-09-11T00:44:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.021+0000 7fb99e000640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 0x7fb98807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.021+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb9a009a750 con 0x7fb9a8152480 2024-09-11T00:44:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.022+0000 7fb9a5e00640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 0x7fb98807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.022+0000 7fb9a5e00640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 0x7fb98807a460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb998033000 tx=0x7fb998004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.025+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb9a0016030 con 0x7fb9a8152480 2024-09-11T00:44:44.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.207+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9a80c3cf0 con 0x7fb9a8152480 2024-09-11T00:44:44.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.208+0000 7fb99e000640 1 -- 172.21.15.81:0/465099951 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fb9a0062790 con 0x7fb9a8152480 2024-09-11T00:44:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:44.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.210+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 msgr2=0x7fb98807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.210+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 0x7fb98807a460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb998033000 tx=0x7fb998004730 comp rx=0 tx=0).stop 2024-09-11T00:44:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.210+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 msgr2=0x7fb9a81f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.210+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000ead0 tx=0x7fb9a000ef90 comp rx=0 tx=0).stop 2024-09-11T00:44:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 shutdown_connections 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb988077fa0 0x7fb98807a460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a8152480 0x7fb9a81f46a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9a81520a0 0x7fb9a81f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 --2- 172.21.15.81:0/465099951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a80c3880 0x7fb9a80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 >> 172.21.15.81:0/465099951 conn(0x7fb9a806c9e0 msgr2=0x7fb9a81508d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 shutdown_connections 2024-09-11T00:44:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.211+0000 7fb9a7200640 1 -- 172.21.15.81:0/465099951 wait complete. 2024-09-11T00:44:44.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:44:44.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 -- 172.21.15.81:0/272961760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa0004d40 msgr2=0x7f1aa00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 --2- 172.21.15.81:0/272961760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa0004d40 0x7f1aa00051c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0769c0 tx=0x7f1aa0005830 comp rx=0 tx=0).stop 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1abbe00640 1 -- 172.21.15.81:0/272961760 reap_dead start 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 -- 172.21.15.81:0/272961760 shutdown_connections 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 -- 172.21.15.81:0/272961760 >> 172.21.15.81:0/272961760 conn(0x7f1abc0700f0 msgr2=0x7f1abc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 -- 172.21.15.81:0/272961760 shutdown_connections 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.383+0000 7f1ac2200640 1 -- 172.21.15.81:0/272961760 wait complete. 2024-09-11T00:44:44.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.384+0000 7f1ac2200640 1 Processor -- start 2024-09-11T00:44:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.384+0000 7f1ac2200640 1 -- start start 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 0x7f1abc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 0x7f1abc0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc070cf0 con 0x7f1abc15a890 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc15c140 con 0x7f1abc1e20d0 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1ac2200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1abc0c8090 con 0x7f1abc15ac70 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.385+0000 7f1abb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60266/0 (socket says 172.21.15.81:60266) 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 -- 172.21.15.81:0/2218884964 learned_addr learned my addr 172.21.15.81:0/2218884964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abaa00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 0x7f1abc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abbe00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 0x7f1abc0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 -- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 msgr2=0x7f1abc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 0x7f1abc0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 -- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 msgr2=0x7f1abc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 0x7f1abc0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 -- 172.21.15.81:0/2218884964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc0737b0 con 0x7f1abc15a890 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abaa00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 0x7f1abc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abbe00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 0x7f1abc0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1abb400640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00e970 tx=0x7f1aac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00cc60 con 0x7f1abc15a890 2024-09-11T00:44:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1aac00ce00 con 0x7f1abc15a890 2024-09-11T00:44:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac005280 con 0x7f1abc15a890 2024-09-11T00:44:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.386+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc073a30 con 0x7f1abc15a890 2024-09-11T00:44:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.387+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc074570 con 0x7f1abc15a890 2024-09-11T00:44:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.387+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc1529f0 con 0x7f1abc15a890 2024-09-11T00:44:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.389+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1aac005420 con 0x7f1abc15a890 2024-09-11T00:44:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.390+0000 7f1ab3400640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 0x7f1a9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.390+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1aac09aa90 con 0x7f1abc15a890 2024-09-11T00:44:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.390+0000 7f1abaa00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 0x7f1a9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.391+0000 7f1abaa00640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 0x7f1a9c07a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1abc073d40 tx=0x7f1aa8006720 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.394+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1abc0737b0 con 0x7f1abc15a890 2024-09-11T00:44:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.576+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1abc0c2a70 con 0x7f1a9c077f70 2024-09-11T00:44:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.584+0000 7f1ab3400640 1 -- 172.21.15.81:0/2218884964 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7f1abc0c2a70 con 0x7f1a9c077f70 2024-09-11T00:44:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 msgr2=0x7f1a9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 0x7f1a9c07a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1abc073d40 tx=0x7f1aa8006720 comp rx=0 tx=0).stop 2024-09-11T00:44:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 msgr2=0x7f1abc1f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00e970 tx=0x7f1aac00ee30 comp rx=0 tx=0).stop 2024-09-11T00:44:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 shutdown_connections 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1a9c077f70 0x7f1a9c07a430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1abc15ac70 0x7f1abc0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1abc1e20d0 0x7f1abc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 --2- 172.21.15.81:0/2218884964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc15a890 0x7f1abc1f4880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 >> 172.21.15.81:0/2218884964 conn(0x7f1abc0700f0 msgr2=0x7f1abc06f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 shutdown_connections 2024-09-11T00:44:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.589+0000 7f1ac2200640 1 -- 172.21.15.81:0/2218884964 wait complete. 2024-09-11T00:44:44.607 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-11T00:44:43.818182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003822"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:44.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 -- 172.21.15.81:0/1955926053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc0c8680 msgr2=0x7f12dc162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 --2- 172.21.15.81:0/1955926053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc0c8680 0x7f12dc162d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12dc15c630 tx=0x7f12d402ab20 comp rx=0 tx=0).stop 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 -- 172.21.15.81:0/1955926053 shutdown_connections 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 --2- 172.21.15.81:0/1955926053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc0c8680 0x7f12dc162d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 --2- 172.21.15.81:0/1955926053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc152610 0x7f12dc0c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 -- 172.21.15.81:0/1955926053 >> 172.21.15.81:0/1955926053 conn(0x7f12dc0700f0 msgr2=0x7f12dc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 -- 172.21.15.81:0/1955926053 shutdown_connections 2024-09-11T00:44:44.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.802+0000 7f12e3c00640 1 -- 172.21.15.81:0/1955926053 wait complete. 2024-09-11T00:44:44.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.804+0000 7f12e3c00640 1 Processor -- start 2024-09-11T00:44:44.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.804+0000 7f12e3c00640 1 -- start start 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 0x7f12dc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 0x7f12dc153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc070cf0 con 0x7f12dc155ac0 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc15c140 con 0x7f12dc152610 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e3c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc0c8090 con 0x7f12dc074860 2024-09-11T00:44:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60282/0 (socket says 172.21.15.81:60282) 2024-09-11T00:44:44.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 -- 172.21.15.81:0/4103135628 learned_addr learned my addr 172.21.15.81:0/4103135628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 -- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 msgr2=0x7f12dc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12dbe00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 0x7f12dc153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1200640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 0x7f12dc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 0x7f12dc15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 -- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 msgr2=0x7f12dc153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 0x7f12dc153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1c00640 1 -- 172.21.15.81:0/4103135628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc15b4d0 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12dbe00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 0x7f12dc153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.805+0000 7f12e1200640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 0x7f12dc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12e1c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009d60 tx=0x7f12d4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4044070 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12d4004250 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc15b7b0 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4004680 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.806+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc159b20 con 0x7f12dc155ac0 2024-09-11T00:44:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.807+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc1529f0 con 0x7f12dc155ac0 2024-09-11T00:44:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.808+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f12d402c8a0 con 0x7f12dc155ac0 2024-09-11T00:44:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.809+0000 7f12d8c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 0x7f12bc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.809+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f12d40ba8c0 con 0x7f12dc155ac0 2024-09-11T00:44:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.809+0000 7f12e1200640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 0x7f12bc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.810+0000 7f12e1200640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 0x7f12bc07a460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009aa0 tx=0x7f12cc005db0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.813+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f12d4032030 con 0x7f12dc155ac0 2024-09-11T00:44:44.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.991+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12dc0c2a70 con 0x7f12bc077fa0 2024-09-11T00:44:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:44.997+0000 7f12d8c00640 1 -- 172.21.15.81:0/4103135628 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7f12dc0c2a70 con 0x7f12bc077fa0 2024-09-11T00:44:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.001+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 msgr2=0x7f12bc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.001+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 0x7f12bc07a460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009aa0 tx=0x7f12cc005db0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.001+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 msgr2=0x7f12dc14dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.001+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009d60 tx=0x7f12d4003f10 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 shutdown_connections 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f12bc077fa0 0x7f12bc07a460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12dc155ac0 0x7f12dc14dca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc152610 0x7f12dc153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 --2- 172.21.15.81:0/4103135628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc074860 0x7f12dc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 >> 172.21.15.81:0/4103135628 conn(0x7f12dc0700f0 msgr2=0x7f12dc0c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 shutdown_connections 2024-09-11T00:44:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.002+0000 7f12e3c00640 1 -- 172.21.15.81:0/4103135628 wait complete. 2024-09-11T00:44:45.020 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-11T00:44:43.818182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003822"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:45.025 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:44:45.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T00:44:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T00:44:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.215+0000 7f405a400640 1 -- 172.21.15.81:0/3387602754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4038004800 msgr2=0x7f4038004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.215+0000 7f405a400640 1 --2- 172.21.15.81:0/3387602754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4038004800 0x7f4038004c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4040006f00 tx=0x7f4038005830 comp rx=0 tx=0).stop 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.216+0000 7f405a400640 1 -- 172.21.15.81:0/3387602754 shutdown_connections 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.216+0000 7f405a400640 1 --2- 172.21.15.81:0/3387602754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4038004800 0x7f4038004c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.216+0000 7f405a400640 1 -- 172.21.15.81:0/3387602754 >> 172.21.15.81:0/3387602754 conn(0x7f40540700f0 msgr2=0x7f4054070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.216+0000 7f405a400640 1 -- 172.21.15.81:0/3387602754 shutdown_connections 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.216+0000 7f405a400640 1 -- 172.21.15.81:0/3387602754 wait complete. 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.217+0000 7f405a400640 1 Processor -- start 2024-09-11T00:44:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.217+0000 7f405a400640 1 -- start start 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4038004800 0x7f405406e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405406efb0 0x7f405414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40540c8680 con 0x7f405414f550 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4054150c90 con 0x7f405406efb0 2024-09-11T00:44:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f405a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40540c8800 con 0x7f4038004800 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f4052a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f4052a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60304/0 (socket says 172.21.15.81:60304) 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.218+0000 7f4052a00640 1 -- 172.21.15.81:0/1919294707 learned_addr learned my addr 172.21.15.81:0/1919294707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4053e00640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405406efb0 0x7f405414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4053400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4038004800 0x7f405406e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 -- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4038004800 msgr2=0x7f405406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4038004800 0x7f405406e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 -- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405406efb0 msgr2=0x7f405414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405406efb0 0x7f405414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 -- 172.21.15.81:0/1919294707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405414fd90 con 0x7f405414f550 2024-09-11T00:44:45.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f4052a00640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f404000c290 tx=0x7f40400017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040001bb0 con 0x7f405414f550 2024-09-11T00:44:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f404003f030 con 0x7f405414f550 2024-09-11T00:44:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405414fab0 con 0x7f405414f550 2024-09-11T00:44:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.219+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040003d70 con 0x7f405414f550 2024-09-11T00:44:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.220+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405414aed0 con 0x7f405414f550 2024-09-11T00:44:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.221+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4054156640 con 0x7f405414f550 2024-09-11T00:44:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.222+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f404002f470 con 0x7f405414f550 2024-09-11T00:44:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.223+0000 7f404b400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 0x7f403407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.223+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f40400bae30 con 0x7f405414f550 2024-09-11T00:44:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.224+0000 7f4053400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 0x7f403407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.224+0000 7f4053400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 0x7f403407a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4044006fd0 tx=0x7f4044006b10 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.227+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4040049020 con 0x7f405414f550 2024-09-11T00:44:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.417+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f4054153f60 con 0x7f405414f550 2024-09-11T00:44:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.417+0000 7f404b400640 1 -- 172.21.15.81:0/1919294707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v32) ==== 86+0+160 (secure 0 0 0) 0x7f40400835d0 con 0x7f405414f550 2024-09-11T00:44:45.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 msgr2=0x7f403407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 0x7f403407a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4044006fd0 tx=0x7f4044006b10 comp rx=0 tx=0).stop 2024-09-11T00:44:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 msgr2=0x7f405414b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f404000c290 tx=0x7f40400017a0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 shutdown_connections 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4034077fa0 0x7f403407a460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f405406efb0 0x7f405414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414f550 0x7f405414b9b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 --2- 172.21.15.81:0/1919294707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4038004800 0x7f405406e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 >> 172.21.15.81:0/1919294707 conn(0x7f40540700f0 msgr2=0x7f4054072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 shutdown_connections 2024-09-11T00:44:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.420+0000 7f405a400640 1 -- 172.21.15.81:0/1919294707 wait complete. 2024-09-11T00:44:45.438 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":32,"timestamp":"2024-09-11T00:44:03.946060+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"3421.388963"}]}] 2024-09-11T00:44:45.438 INFO:tasks.ceph_manager:config epoch is 32 2024-09-11T00:44:45.438 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:44:45.438 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:44:45.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 -- 172.21.15.81:0/2923302025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 msgr2=0x7f0bf00c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2923302025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf00c8a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009860 tx=0x7f0be002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 -- 172.21.15.81:0/2923302025 shutdown_connections 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2923302025 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf0071c00 0x7f0bf00c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2923302025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf00c8a20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 -- 172.21.15.81:0/2923302025 >> 172.21.15.81:0/2923302025 conn(0x7f0bf00710e0 msgr2=0x7f0bf00714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 -- 172.21.15.81:0/2923302025 shutdown_connections 2024-09-11T00:44:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.593+0000 7f0bf6200640 1 -- 172.21.15.81:0/2923302025 wait complete. 2024-09-11T00:44:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.595+0000 7f0bf6200640 1 Processor -- start 2024-09-11T00:44:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.595+0000 7f0bf6200640 1 -- start start 2024-09-11T00:44:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf015dc10 0x7f0bf014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf00b2410 con 0x7f0bf0071c00 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0154cf0 con 0x7f0bf0154910 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bf6200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf00709b0 con 0x7f0bf015dc10 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60316/0 (socket says 172.21.15.81:60316) 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 -- 172.21.15.81:0/2495074359 learned_addr learned my addr 172.21.15.81:0/2495074359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0beea00640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0befe00640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf015dc10 0x7f0bf014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 -- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf015dc10 msgr2=0x7f0bf014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf015dc10 0x7f0bf014ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 -- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 msgr2=0x7f0bf006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.596+0000 7f0bef400640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf006e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0bef400640 1 -- 172.21.15.81:0/2495074359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf01f0c30 con 0x7f0bf0071c00 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0bef400640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be0000c00 tx=0x7f0be0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0040070 con 0x7f0bf0071c00 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be00038e0 con 0x7f0bf0071c00 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0003d30 con 0x7f0bf0071c00 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf01f0f10 con 0x7f0bf0071c00 2024-09-11T00:44:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.597+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01f14d0 con 0x7f0bf0071c00 2024-09-11T00:44:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.598+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf006acb0 con 0x7f0bf0071c00 2024-09-11T00:44:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.599+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0be0045670 con 0x7f0bf0071c00 2024-09-11T00:44:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.601+0000 7f0be7400640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 0x7f0bd007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.601+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0be00bb910 con 0x7f0bf0071c00 2024-09-11T00:44:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.601+0000 7f0beea00640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 0x7f0bd007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:45.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.602+0000 7f0beea00640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 0x7f0bd007a460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bf01ee610 tx=0x7f0bdc009260 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.605+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0bf006acb0 con 0x7f0bf0071c00 2024-09-11T00:44:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.836+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0bf015c150 con 0x7f0bf0071c00 2024-09-11T00:44:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.839+0000 7f0be7400640 1 -- 172.21.15.81:0/2495074359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193249 (secure 0 0 0) 0x7f0bf015c150 con 0x7f0bf0071c00 2024-09-11T00:44:45.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 msgr2=0x7f0bd007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 0x7f0bd007a460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bf01ee610 tx=0x7f0bdc009260 comp rx=0 tx=0).stop 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 msgr2=0x7f0bf006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be0000c00 tx=0x7f0be0032c10 comp rx=0 tx=0).stop 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 shutdown_connections 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0bd0077fa0 0x7f0bd007a460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf015dc10 0x7f0bf014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bf0154910 0x7f0bf006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 --2- 172.21.15.81:0/2495074359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0071c00 0x7f0bf006dd10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.842+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 >> 172.21.15.81:0/2495074359 conn(0x7f0bf00710e0 msgr2=0x7f0bf015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.843+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 shutdown_connections 2024-09-11T00:44:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:45.843+0000 7f0bf6200640 1 -- 172.21.15.81:0/2495074359 wait complete. 2024-09-11T00:44:45.860 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4124,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1151185883},{"type":"v1","addr":"172.21.15.167:6801","nonce":1151185883}]},"active_addr":"172.21.15.167:6801/1151185883","active_change":"2024-09-11T00:43:55.799116+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4122,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1006069077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":3022786812}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":2515330372}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":409958419}]}]} 2024-09-11T00:44:45.865 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T00:44:45.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T00:44:45.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 -- 172.21.15.81:0/1395702729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac152610 msgr2=0x7fe7ac0c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1395702729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac152610 0x7fe7ac0c0f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0769a0 tx=0x7fe7a002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 -- 172.21.15.81:0/1395702729 shutdown_connections 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1395702729 >> v2:172.21.15.167:3300/0 conn(0x7fe7ac0c8680 0x7fe7ac162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1395702729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac152610 0x7fe7ac0c0f90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 -- 172.21.15.81:0/1395702729 >> 172.21.15.81:0/1395702729 conn(0x7fe7ac0700f0 msgr2=0x7fe7ac070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 -- 172.21.15.81:0/1395702729 shutdown_connections 2024-09-11T00:44:46.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.019+0000 7fe7b4000640 1 -- 172.21.15.81:0/1395702729 wait complete. 2024-09-11T00:44:46.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.020+0000 7fe7b4000640 1 Processor -- start 2024-09-11T00:44:46.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.021+0000 7fe7b4000640 1 -- start start 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.021+0000 7fe7b4000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b4000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7ac152610 0x7fe7ac0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b4000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7ac074280 0x7fe7ac15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b4000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac070cf0 con 0x7fe7ac074860 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b4000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac15c140 con 0x7fe7ac074280 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b4000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0c8090 con 0x7fe7ac152610 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60332/0 (socket says 172.21.15.81:60332) 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 -- 172.21.15.81:0/1457022396 learned_addr learned my addr 172.21.15.81:0/1457022396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 -- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7ac152610 msgr2=0x7fe7ac0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7ac152610 0x7fe7ac0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 -- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7ac074280 msgr2=0x7fe7ac15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7ac074280 0x7fe7ac15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 -- 172.21.15.81:0/1457022396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0b0060 con 0x7fe7ac074860 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.022+0000 7fe7b1600640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7a002abc0 tx=0x7fe7a00339f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.023+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0031950 con 0x7fe7ac074860 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.023+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7a0031be0 con 0x7fe7ac074860 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.023+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0005020 con 0x7fe7ac074860 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.023+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac073170 con 0x7fe7ac074860 2024-09-11T00:44:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.023+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac0b02d0 con 0x7fe7ac074860 2024-09-11T00:44:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.024+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac1529f0 con 0x7fe7ac074860 2024-09-11T00:44:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.025+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe7a00051e0 con 0x7fe7ac074860 2024-09-11T00:44:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.026+0000 7fe7a9600640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 0x7fe78c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.026+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe7a00bb0d0 con 0x7fe7ac074860 2024-09-11T00:44:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.026+0000 7fe7b0c00640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 0x7fe78c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.027+0000 7fe7b0c00640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 0x7fe78c07a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe798007fd0 tx=0x7fe798007900 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.030+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe7a003f030 con 0x7fe7ac074860 2024-09-11T00:44:46.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.211+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7ac0ccd80 con 0x7fe7ac074860 2024-09-11T00:44:46.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.212+0000 7fe7a9600640 1 -- 172.21.15.81:0/1457022396 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fe7a00837f0 con 0x7fe7ac074860 2024-09-11T00:44:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:46.215 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 msgr2=0x7fe78c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 0x7fe78c07a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe798007fd0 tx=0x7fe798007900 comp rx=0 tx=0).stop 2024-09-11T00:44:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 msgr2=0x7fe7ac073ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7a002abc0 tx=0x7fe7a00339f0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 shutdown_connections 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe78c077f70 0x7fe78c07a430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7ac074280 0x7fe7ac15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7ac152610 0x7fe7ac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 --2- 172.21.15.81:0/1457022396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac074860 0x7fe7ac073ad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 >> 172.21.15.81:0/1457022396 conn(0x7fe7ac0700f0 msgr2=0x7fe7ac14e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 shutdown_connections 2024-09-11T00:44:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.215+0000 7fe7b4000640 1 -- 172.21.15.81:0/1457022396 wait complete. 2024-09-11T00:44:46.233 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T00:44:46.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 -- 172.21.15.81:0/4218425814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b014ebc0 msgr2=0x7f73b006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 --2- 172.21.15.81:0/4218425814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b014ebc0 0x7f73b006d450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f73b0152770 tx=0x7f73a002aab0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 -- 172.21.15.81:0/4218425814 shutdown_connections 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 --2- 172.21.15.81:0/4218425814 >> v2:172.21.15.167:3300/0 conn(0x7f73b015ba70 0x7f73b015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 --2- 172.21.15.81:0/4218425814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b014ebc0 0x7f73b006d450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 -- 172.21.15.81:0/4218425814 >> 172.21.15.81:0/4218425814 conn(0x7f73b006ffd0 msgr2=0x7f73b00703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 -- 172.21.15.81:0/4218425814 shutdown_connections 2024-09-11T00:44:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.387+0000 7f73b4a00640 1 -- 172.21.15.81:0/4218425814 wait complete. 2024-09-11T00:44:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.389+0000 7f73b4a00640 1 Processor -- start 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.389+0000 7f73b4a00640 1 -- start start 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.389+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b00b1f10 0x7f73b00b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.389+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73b014ebc0 0x7f73b00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.389+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73b4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01581a0 con 0x7f73b015ba70 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73b4a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73b0159010 con 0x7f73b00b1f10 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73b4a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73b00c7040 con 0x7f73b014ebc0 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60346/0 (socket says 172.21.15.81:60346) 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 -- 172.21.15.81:0/2740299607 learned_addr learned my addr 172.21.15.81:0/2740299607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73af400640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b00b1f10 0x7f73b00b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73aea00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73b014ebc0 0x7f73b00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 -- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73b014ebc0 msgr2=0x7f73b00c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73b014ebc0 0x7f73b00c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 -- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b00b1f10 msgr2=0x7f73b00b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b00b1f10 0x7f73b00b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.390+0000 7f73afe00640 1 -- 172.21.15.81:0/2740299607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b00c57e0 con 0x7f73b015ba70 2024-09-11T00:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73afe00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b440 tx=0x7f73a800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8015020 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a8011920 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b0072510 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011d70 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.391+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b01f4ff0 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.392+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b014eff0 con 0x7f73b015ba70 2024-09-11T00:44:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.393+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f73a801a400 con 0x7f73b015ba70 2024-09-11T00:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.395+0000 7f73a7400640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 0x7f739007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.395+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f73a809a160 con 0x7f73b015ba70 2024-09-11T00:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.395+0000 7f73af400640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 0x7f739007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.396+0000 7f73af400640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 0x7f739007a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73a0035000 tx=0x7f73a0039040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.399+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f73a801f020 con 0x7f73b015ba70 2024-09-11T00:44:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.586+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73b00c8400 con 0x7f73b015ba70 2024-09-11T00:44:46.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.588+0000 7f73a7400640 1 -- 172.21.15.81:0/2740299607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f73a80622e0 con 0x7f73b015ba70 2024-09-11T00:44:46.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:46.590 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 msgr2=0x7f739007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 0x7f739007a460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73a0035000 tx=0x7f73a0039040 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 msgr2=0x7f73b0149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b440 tx=0x7f73a800b900 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 shutdown_connections 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7390077fa0 0x7f739007a460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b015ba70 0x7f73b0149570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73b014ebc0 0x7f73b00c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 --2- 172.21.15.81:0/2740299607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b00b1f10 0x7f73b00b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 >> 172.21.15.81:0/2740299607 conn(0x7f73b006ffd0 msgr2=0x7f73b00c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 shutdown_connections 2024-09-11T00:44:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.590+0000 7f73b4a00640 1 -- 172.21.15.81:0/2740299607 wait complete. 2024-09-11T00:44:46.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T00:44:46.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T00:44:46.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T00:44:46.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T00:44:46.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T00:44:46.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T00:44:46.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T00:44:46.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 -- 172.21.15.81:0/4276402184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f80074f50 msgr2=0x7f8f800c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 --2- 172.21.15.81:0/4276402184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f80074f50 0x7f8f800c99a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009830 tx=0x7f8f6c02a540 comp rx=0 tx=0).stop 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 -- 172.21.15.81:0/4276402184 shutdown_connections 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 --2- 172.21.15.81:0/4276402184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f80074f50 0x7f8f800c99a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 --2- 172.21.15.81:0/4276402184 >> v2:172.21.15.167:3300/0 conn(0x7f8f800cd3c0 0x7f8f80071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.888+0000 7f8f85800640 1 -- 172.21.15.81:0/4276402184 >> 172.21.15.81:0/4276402184 conn(0x7f8f8006f1f0 msgr2=0x7f8f8006f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.889+0000 7f8f85800640 1 -- 172.21.15.81:0/4276402184 shutdown_connections 2024-09-11T00:44:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.889+0000 7f8f85800640 1 -- 172.21.15.81:0/4276402184 wait complete. 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.889+0000 7f6cac400640 1 -- 172.21.15.81:0/3113895718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 msgr2=0x7f6ca40cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.889+0000 7f6cac400640 1 --2- 172.21.15.81:0/3113895718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca40cc280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c98005fd0 tx=0x7f6c9802a680 comp rx=0 tx=0).stop 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 -- 172.21.15.81:0/3113895718 shutdown_connections 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 --2- 172.21.15.81:0/3113895718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 0x7f6ca415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 --2- 172.21.15.81:0/3113895718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca40cc280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 -- 172.21.15.81:0/3113895718 >> 172.21.15.81:0/3113895718 conn(0x7f6ca406d570 msgr2=0x7f6ca406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 -- 172.21.15.81:0/3113895718 shutdown_connections 2024-09-11T00:44:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.890+0000 7f6cac400640 1 -- 172.21.15.81:0/3113895718 wait complete. 2024-09-11T00:44:46.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.892+0000 7f8f85800640 1 Processor -- start 2024-09-11T00:44:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.893+0000 7f6cac400640 1 Processor -- start 2024-09-11T00:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f6cac400640 1 -- start start 2024-09-11T00:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9174a00640 1 -- 172.21.15.81:0/1259506353 reap_dead start 2024-09-11T00:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f916fe00640 1 --2- 172.21.15.81:0/1259506353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9154003a00 0x7f9154003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9176a00640 1 -- 172.21.15.81:0/1259506353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154004800 msgr2=0x7f9154004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9176a00640 1 --2- 172.21.15.81:0/1259506353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154004800 0x7f9154004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91700cc040 tx=0x7f9154005830 comp rx=0 tx=0).stop 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.893+0000 7f8f85800640 1 -- start start 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f80074f50 0x7f8f80155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f800cd3c0 0x7f8f800cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 0x7f8f8014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f80071c50 con 0x7f8f80074f50 2024-09-11T00:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f800c9700 con 0x7f8f800cd3c0 2024-09-11T00:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f8f85800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8f80071dd0 con 0x7f8f800cd7a0 2024-09-11T00:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9176a00640 1 -- 172.21.15.81:0/1259506353 shutdown_connections 2024-09-11T00:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9176a00640 1 --2- 172.21.15.81:0/1259506353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154004800 0x7f9154004c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.894+0000 7f9176a00640 1 -- 172.21.15.81:0/1259506353 >> 172.21.15.81:0/1259506353 conn(0x7f9170070760 msgr2=0x7f9170070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f9176a00640 1 -- 172.21.15.81:0/1259506353 shutdown_connections 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f8f7fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f80074f50 0x7f8f80155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f8f84e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 0x7f8f8014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f8f84e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 0x7f8f8014b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:59770/0 (socket says 172.21.15.81:59770) 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f8f84e00640 1 -- 172.21.15.81:0/4267433583 learned_addr learned my addr 172.21.15.81:0/4267433583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f8f7f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f800cd3c0 0x7f8f800cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.895+0000 7f9176a00640 1 -- 172.21.15.81:0/1259506353 wait complete. 2024-09-11T00:44:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f6cac400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca40cb1d0 0x7f6ca415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f6cac400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca4148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f7f400640 1 -- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 msgr2=0x7f8f8014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f6cac400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 0x7f6ca41f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f6ca9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca40cb1d0 0x7f6ca415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f7f400640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 0x7f8f8014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f7f400640 1 -- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f80074f50 msgr2=0x7f8f80155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f7f400640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f80074f50 0x7f8f80155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f7f400640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f800c7060 con 0x7f8f800cd3c0 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f8f84e00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f800cd7a0 0x7f8f8014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f8f7fe00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f80074f50 0x7f8f80155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.896+0000 7f6ca9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca4148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6ca9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca4148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60388/0 (socket says 172.21.15.81:60388) 2024-09-11T00:44:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6ca9000640 1 -- 172.21.15.81:0/1557078347 learned_addr learned my addr 172.21.15.81:0/1557078347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6caa400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 0x7f6ca41f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f8f7f400640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f800cd3c0 0x7f8f800cc200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c031000 tx=0x7f8f6c032c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca40cc7c0 con 0x7f6ca40d08e0 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca415e780 con 0x7f6ca40cb1d0 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca40cc940 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f9176a00640 1 Processor -- start 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f9176a00640 1 -- start start 2024-09-11T00:44:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.897+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c040070 con 0x7f8f800cd3c0 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6caa400640 1 -- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca40cb1d0 msgr2=0x7f6ca415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6caa400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca40cb1d0 0x7f6ca415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6caa400640 1 -- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 msgr2=0x7f6ca4148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6caa400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca4148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6caa400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca415c420 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f6ca9000640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ca40d08e0 0x7f6ca4148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7ff0e7200640 1 -- 172.21.15.81:0/1753660637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 msgr2=0x7ff0e0050490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7ff0e7200640 1 --2- 172.21.15.81:0/1753660637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 0x7ff0e0050490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009860 tx=0x7ff0d402a5c0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f6c005310 con 0x7f8f800cd3c0 2024-09-11T00:44:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c003800 con 0x7f8f800cd3c0 2024-09-11T00:44:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.898+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f80156720 con 0x7f8f800cd3c0 2024-09-11T00:44:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f6caa400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 0x7f6ca41f83c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c700 tx=0x7f6c9c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8006ccc0 con 0x7f8f800cd3c0 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c003b70 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c9c003d10 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c005330 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 0x7f9170153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91700c5f80 0x7f91701e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91701f5180 0x7f91701f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9170159660 con 0x7f91701f5180 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91701594e0 con 0x7f9154004800 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.899+0000 7f9176a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f917015bc30 con 0x7f91700c5f80 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 0x7f9170153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca40ce160 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca40b5780 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 0x7f9170153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53250/0 (socket says 172.21.15.81:53250) 2024-09-11T00:44:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 -- 172.21.15.81:0/2858679599 learned_addr learned my addr 172.21.15.81:0/2858679599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916f400640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91700c5f80 0x7f91701e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7ff0e7200640 1 -- 172.21.15.81:0/1753660637 shutdown_connections 2024-09-11T00:44:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7ff0e7200640 1 --2- 172.21.15.81:0/1753660637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 0x7ff0e0050490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7ff0e7200640 1 -- 172.21.15.81:0/1753660637 >> 172.21.15.81:0/1753660637 conn(0x7ff0e0050ae0 msgr2=0x7ff0e0050ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f9174a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91701f5180 0x7f91701f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 -- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91700c5f80 msgr2=0x7f91701e1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91700c5f80 0x7f91701e1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 -- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91701f5180 msgr2=0x7f91701f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91701f5180 0x7f91701f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.900+0000 7f916fe00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91701f5b40 con 0x7f9154004800 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.901+0000 7f9174a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91701f5180 0x7f91701f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.901+0000 7ff0e7200640 1 -- 172.21.15.81:0/1753660637 shutdown_connections 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.901+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8f6c0039a0 con 0x7f8f800cd3c0 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.902+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f80156540 con 0x7f8f800cd3c0 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.902+0000 7f8f77e00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8f60077f70 0x7f8f6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8f6c0b95e0 con 0x7f8f800cd3c0 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f8f7fe00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8f60077f70 0x7f8f6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f8f77e00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f8f600822b0 0x7f8f60084750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f60084e20 con 0x7f8f600822b0 2024-09-11T00:44:46.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f6c07fc40 con 0x7f8f800cd3c0 2024-09-11T00:44:46.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7ff0e7200640 1 -- 172.21.15.81:0/1753660637 wait complete. 2024-09-11T00:44:46.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.903+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6c9c0054d0 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.904+0000 7f8f7fe00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8f60077f70 0x7f8f6007a430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009fd0 tx=0x7f8f78009680 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.904+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ca40cc280 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.904+0000 7f6ca1600640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6c84078070 0x7f6c8407a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6c9c099ab0 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f6ca9a00640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6c84078070 0x7f6c8407a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f6ca1600640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7f6c84081770 0x7f6c84083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c9c011e50 con 0x7f6c84081770 2024-09-11T00:44:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6c9c05db30 con 0x7f6ca40d0cc0 2024-09-11T00:44:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f916fe00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 0x7f9170153fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f916800dd30 tx=0x7f916800b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f173c000640 1 -- 172.21.15.81:0/3079519729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1734152610 msgr2=0x7f17340c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f173c000640 1 --2- 172.21.15.81:0/3079519729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1734152610 0x7f17340c0f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f173415c630 tx=0x7f172802a650 comp rx=0 tx=0).stop 2024-09-11T00:44:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f8f84e00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f8f600822b0 0x7f8f60084750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f173c000640 1 -- 172.21.15.81:0/3079519729 shutdown_connections 2024-09-11T00:44:46.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.905+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168003b90 con 0x7f9154004800 2024-09-11T00:44:46.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9168003d30 con 0x7f9154004800 2024-09-11T00:44:46.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168004280 con 0x7f9154004800 2024-09-11T00:44:46.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91700c79b0 con 0x7f9154004800 2024-09-11T00:44:46.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f173c000640 1 --2- 172.21.15.81:0/3079519729 >> v2:172.21.15.167:3300/0 conn(0x7f17340c8680 0x7f1734162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f173c000640 1 --2- 172.21.15.81:0/3079519729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1734152610 0x7f17340c0f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f173c000640 1 -- 172.21.15.81:0/3079519729 >> 172.21.15.81:0/3079519729 conn(0x7f17340700f0 msgr2=0x7f1734070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f6ca9000640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7f6c84081770 0x7f6c84083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91700c7f70 con 0x7f9154004800 2024-09-11T00:44:46.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7ff0e7200640 1 Processor -- start 2024-09-11T00:44:46.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f6ca9a00640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6c84078070 0x7f6c8407a530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c98033000 tx=0x7f6c98004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.906+0000 7f173c000640 1 -- 172.21.15.81:0/3079519729 shutdown_connections 2024-09-11T00:44:46.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7f6ca9000640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7f6c84081770 0x7f6c84083bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7f8f84e00640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f8f600822b0 0x7f8f60084750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7f53b0200640 1 -- 172.21.15.81:0/1601798660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80c8680 msgr2=0x7f53a81508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7f53b0200640 1 --2- 172.21.15.81:0/1601798660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80c8680 0x7f53a81508b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5394005fd0 tx=0x7f539402b860 comp rx=0 tx=0).stop 2024-09-11T00:44:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.908+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91700c7760 con 0x7f9154004800 2024-09-11T00:44:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7ff0e7200640 1 -- start start 2024-09-11T00:44:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.907+0000 7f173c000640 1 -- 172.21.15.81:0/3079519729 wait complete. 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.908+0000 7f53b0200640 1 -- 172.21.15.81:0/1601798660 shutdown_connections 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.908+0000 7f53b0200640 1 --2- 172.21.15.81:0/1601798660 >> v2:172.21.15.167:3300/0 conn(0x7f53a8156640 0x7f53a8073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.908+0000 7f53b0200640 1 --2- 172.21.15.81:0/1601798660 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80c8680 0x7f53a81508b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.908+0000 7f53b0200640 1 -- 172.21.15.81:0/1601798660 >> 172.21.15.81:0/1601798660 conn(0x7f53a80700f0 msgr2=0x7f53a8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7f53b0200640 1 -- 172.21.15.81:0/1601798660 shutdown_connections 2024-09-11T00:44:46.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 0x7ff0e00db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 0x7ff0e00e1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0e004f2e0 0x7ff0e01698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0050110 con 0x7ff0e004ef00 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0005f40 con 0x7ff0e004f2e0 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7ff0e7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e0050290 con 0x7ff0e004dec0 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.909+0000 7f53b0200640 1 -- 172.21.15.81:0/1601798660 wait complete. 2024-09-11T00:44:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.910+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== osd.0 v2:172.21.15.81:6800/1565697795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f60084e20 con 0x7f8f600822b0 2024-09-11T00:44:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.910+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== osd.1 v2:172.21.15.81:6816/1592127640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c9c011e50 con 0x7f6c84081770 2024-09-11T00:44:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.912+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9168004420 con 0x7f9154004800 2024-09-11T00:44:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.910+0000 7ff0e5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 0x7ff0e00db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 0x7ff0e00e1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 0x7ff0e00e1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60414/0 (socket says 172.21.15.81:60414) 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 -- 172.21.15.81:0/764179001 learned_addr learned my addr 172.21.15.81:0/764179001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e6800640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0e004f2e0 0x7ff0e01698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 -- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 msgr2=0x7ff0e00db4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0e004dec0 0x7ff0e00db4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 -- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0e004f2e0 msgr2=0x7ff0e01698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0e004f2e0 0x7ff0e01698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7ff0e5400640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e00dfa10 con 0x7ff0e004ef00 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.912+0000 7ff0e5400640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 0x7ff0e00e1820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009980 tx=0x7ff0d4032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7f173c000640 1 Processor -- start 2024-09-11T00:44:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.911+0000 7f173c000640 1 -- start start 2024-09-11T00:44:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 0x7f1734073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f53b0200640 1 Processor -- start 2024-09-11T00:44:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1734152610 0x7f17340c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f173414c3e0 0x7f17341596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1734070cf0 con 0x7f1734152610 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f173415c140 con 0x7f1734074860 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f173c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f17340c8090 con 0x7f173414c3e0 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f9167e00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9150077fc0 0x7f915007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f916809ac40 con 0x7f9154004800 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f916f400640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9150077fc0 0x7f915007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f9167e00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f9150081740 0x7f9150083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9150084250 con 0x7f9150081740 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f916809f2a0 con 0x7f9154004800 2024-09-11T00:44:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f916f400640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9150077fc0 0x7f915007a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f915c033000 tx=0x7f915c02d000 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f9174a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f9150081740 0x7f9150083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4040070 con 0x7ff0e004ef00 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0d4005220 con 0x7ff0e004ef00 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4040070 con 0x7ff0e004ef00 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01691e0 con 0x7ff0e004ef00 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f1739600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 0x7f1734073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f1739600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 0x7f1734073910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53284/0 (socket says 172.21.15.81:53284) 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f1739600640 1 -- 172.21.15.81:0/1557672680 learned_addr learned my addr 172.21.15.81:0/1557672680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f173a000640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f173414c3e0 0x7f17341596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f1738c00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1734152610 0x7f17340c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f1739600640 1 -- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f173414c3e0 msgr2=0x7f17341596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f1739600640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f173414c3e0 0x7f17341596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f1739600640 1 -- 172.21.15.81:0/1557672680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1734152610 msgr2=0x7f17340c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f1739600640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1734152610 0x7f17340c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f1739600640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340cb3e0 con 0x7f1734074860 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f173a000640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f173414c3e0 0x7f17341596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f1738c00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1734152610 0x7f17340c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:46.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.913+0000 7f53b0200640 1 -- start start 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a8070c10 0x7f53a806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 0x7f53a80c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80ca2b0 0x7f53a80c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53a80740b0 con 0x7f53a80afb80 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53a8073650 con 0x7f53a8070c10 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53b0200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f53a8074230 con 0x7f53a80ca2b0 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7f53ace00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 0x7f53a80c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f53ace00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 0x7f53a80c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60432/0 (socket says 172.21.15.81:60432) 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f53ace00640 1 -- 172.21.15.81:0/2297081319 learned_addr learned my addr 172.21.15.81:0/2297081319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f53ae200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80ca2b0 0x7f53a80c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.915+0000 7f53ad800640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a8070c10 0x7f53a806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f53ae200640 1 -- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a8070c10 msgr2=0x7f53a806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f53ae200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53a8070c10 0x7f53a806d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f53ae200640 1 -- 172.21.15.81:0/2297081319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 msgr2=0x7f53a80c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 -- 172.21.15.81:0/2974335716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 msgr2=0x7efde00c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 --2- 172.21.15.81:0/2974335716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde00c2880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efde00b2270 tx=0x7efdcc02b2a0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 -- 172.21.15.81:0/2974335716 shutdown_connections 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 --2- 172.21.15.81:0/2974335716 >> v2:172.21.15.81:3300/0 conn(0x7efde0070c10 0x7efde00c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 --2- 172.21.15.81:0/2974335716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde00c2880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 -- 172.21.15.81:0/2974335716 >> 172.21.15.81:0/2974335716 conn(0x7efde00700f0 msgr2=0x7efde0070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 -- 172.21.15.81:0/2974335716 shutdown_connections 2024-09-11T00:44:46.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.914+0000 7efde5000640 1 -- 172.21.15.81:0/2974335716 wait complete. 2024-09-11T00:44:46.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f9174a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f9150081740 0x7f9150083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f1739600640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 0x7f1734073910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1728000c00 tx=0x7f1728003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f53ae200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 0x7f53a80c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7f53ae200640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a806e120 con 0x7f53a80ca2b0 2024-09-11T00:44:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.916+0000 7efde5000640 1 Processor -- start 2024-09-11T00:44:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7efde5000640 1 -- start start 2024-09-11T00:44:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f53ace00640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53a80afb80 0x7f53a80c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f53ae200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80ca2b0 0x7f53a80c5950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53a000ca00 tx=0x7f53a000cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172803e030 con 0x7f1734074860 2024-09-11T00:44:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e016ab10 con 0x7ff0e004ef00 2024-09-11T00:44:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== osd.2 v2:172.21.15.81:6824/2087915132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9150084250 con 0x7f9150081740 2024-09-11T00:44:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1728003d10 con 0x7f1734074860 2024-09-11T00:44:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.917+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728035040 con 0x7f1734074860 2024-09-11T00:44:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efde0070c10 0x7efde01468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde0160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0004d20 con 0x7f53a80ca2b0 2024-09-11T00:44:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53a0007ad0 con 0x7f53a80ca2b0 2024-09-11T00:44:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0005020 con 0x7f53a80ca2b0 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde0160fc0 0x7efde0160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efde0156640 con 0x7efde0160fc0 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efde0150c90 con 0x7efde01508b0 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7efde5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efde01567c0 con 0x7efde0070c10 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efde0070c10 0x7efde01468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde0160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde0160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53312/0 (socket says 172.21.15.81:53312) 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 -- 172.21.15.81:0/3731379290 learned_addr learned my addr 172.21.15.81:0/3731379290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0e00367d0 con 0x7ff0e004ef00 2024-09-11T00:44:46.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efdde800640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde0160fc0 0x7efde0160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7f173c000640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1734163ef0 con 0x7f1734074860 2024-09-11T00:44:46.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.918+0000 7f173c000640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17340cbd30 con 0x7f1734074860 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a814f2b0 con 0x7f53a80ca2b0 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a814ed80 con 0x7f53a80ca2b0 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 -- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efde0070c10 msgr2=0x7efde01468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efde0070c10 0x7efde01468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 -- 172.21.15.81:0/3731379290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde0160fc0 msgr2=0x7efde0160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde0160fc0 0x7efde0160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.919+0000 7efddd400640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0161620 con 0x7efde01508b0 2024-09-11T00:44:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.920+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1708001030 con 0x7f1734074860 2024-09-11T00:44:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.920+0000 7efddd400640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde0160420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b4a0 tx=0x7efdd000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.920+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0014070 con 0x7efde01508b0 2024-09-11T00:44:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.921+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdd0010700 con 0x7efde01508b0 2024-09-11T00:44:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.921+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0010b30 con 0x7efde01508b0 2024-09-11T00:44:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.921+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53a814fd20 con 0x7f53a80ca2b0 2024-09-11T00:44:46.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde006f630 con 0x7efde01508b0 2024-09-11T00:44:46.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde006e1c0 con 0x7efde01508b0 2024-09-11T00:44:46.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 -- 172.21.15.81:0/2817862727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 msgr2=0x7fc94815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 --2- 172.21.15.81:0/2817862727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc94815a7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc934005fd0 tx=0x7fc93402a660 comp rx=0 tx=0).stop 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff0d4005410 con 0x7ff0e004ef00 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 -- 172.21.15.81:0/2817862727 shutdown_connections 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 --2- 172.21.15.81:0/2817862727 >> v2:172.21.15.167:3300/0 conn(0x7fc94815ad10 0x7fc9480d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 --2- 172.21.15.81:0/2817862727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc94815a7d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7fc94fe00640 1 -- 172.21.15.81:0/2817862727 >> 172.21.15.81:0/2817862727 conn(0x7fc94806d570 msgr2=0x7fc94806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.922+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f17280049e0 con 0x7f1734074860 2024-09-11T00:44:46.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.923+0000 7fc94fe00640 1 -- 172.21.15.81:0/2817862727 shutdown_connections 2024-09-11T00:44:46.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f53a00051c0 con 0x7f53a80ca2b0 2024-09-11T00:44:46.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7ff0de000640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff0c8078170 0x7ff0c807a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff0d40bb130 con 0x7ff0e004ef00 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7ff0de000640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7ff0c80818e0 0x7ff0c8083d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0c80843f0 con 0x7ff0c80818e0 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff0d40bb520 con 0x7ff0e004ef00 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7f1731600640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1714077fa0 0x7f171407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.924+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f17280baa30 con 0x7f1734074860 2024-09-11T00:44:46.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7ff0e5e00640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff0c8078170 0x7ff0c807a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7f1731600640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f1714081690 0x7f1714083ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1728040e50 con 0x7f1714081690 2024-09-11T00:44:46.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7ff0e6800640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7ff0c80818e0 0x7ff0c8083d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17280bf2a0 con 0x7f1734074860 2024-09-11T00:44:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7f53a5600640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5388077f70 0x7f538807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f53a009a660 con 0x7f53a80ca2b0 2024-09-11T00:44:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7f1738c00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1714077fa0 0x7f171407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f53a5600640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f5388081660 0x7f5388083aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53a000a100 con 0x7f5388081660 2024-09-11T00:44:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.923+0000 7fc94fe00640 1 -- 172.21.15.81:0/2817862727 wait complete. 2024-09-11T00:44:46.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.925+0000 7fc94fe00640 1 Processor -- start 2024-09-11T00:44:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f1738c00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1714077fa0 0x7f171407a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1734151650 tx=0x7f1720009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53a00a1050 con 0x7f53a80ca2b0 2024-09-11T00:44:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7f53ad800640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5388077f70 0x7f538807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7ff0e5e00640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff0c8078170 0x7ff0c807a630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80046b0 tx=0x7ff0d8007e90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7ff0e6800640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7ff0c80818e0 0x7ff0c8083d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efde0072650 con 0x7efde01508b0 2024-09-11T00:44:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== osd.3 v2:172.21.15.81:6801/3351502338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0c80843f0 con 0x7ff0c80818e0 2024-09-11T00:44:46.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.926+0000 7fc94fe00640 1 -- start start 2024-09-11T00:44:46.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7f53ad800640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5388077f70 0x7f538807a430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f539c004ea0 tx=0x7f539c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7f173a000640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f1714081690 0x7f1714083ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7f53ace00640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f5388081660 0x7f5388083aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc9481f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc948154a10 0x7fc9481505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94815ad10 0x7fc94814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc94815e780 con 0x7fc948154a10 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc94815e4a0 con 0x7fc94815ad10 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.928+0000 7fc94fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc948154df0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc9481f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc9481f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:59860/0 (socket says 172.21.15.81:59860) 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 -- 172.21.15.81:0/1008015921 learned_addr learned my addr 172.21.15.81:0/1008015921 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:46.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94de00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94815ad10 0x7fc94814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7f173a000640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f1714081690 0x7f1714083ad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94ca00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc948154a10 0x7fc9481505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 -- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94815ad10 msgr2=0x7fc94814f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc94815ad10 0x7fc94814f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 -- 172.21.15.81:0/1008015921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc948154a10 msgr2=0x7fc9481505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7f53ace00640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f5388081660 0x7f5388083aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efdd0019450 con 0x7efde01508b0 2024-09-11T00:44:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc948154a10 0x7fc9481505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94d400640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9480c68e0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.929+0000 7fc94ca00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc948154a10 0x7fc9481505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:46.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.930+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== osd.4 v2:172.21.15.167:6802/2940055079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1728040e50 con 0x7f1714081690 2024-09-11T00:44:46.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.930+0000 7fc94d400640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc9481f5040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00c530 tx=0x7fc93c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efdd6000640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efdc0077fc0 0x7efdc007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== osd.5 v2:172.21.15.167:6818/3209520310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53a000a100 con 0x7f5388081660 2024-09-11T00:44:46.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0052d0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc93c005470 con 0x7fc9480cb1d0 2024-09-11T00:44:46.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c012870 con 0x7fc9480cb1d0 2024-09-11T00:44:46.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efdd009a330 con 0x7efde01508b0 2024-09-11T00:44:46.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9480ce080 con 0x7fc9480cb1d0 2024-09-11T00:44:46.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efdd6000640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7efdc0081730 0x7efdc0083b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc948153610 con 0x7fc9480cb1d0 2024-09-11T00:44:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdc0084240 con 0x7efdc0081730 2024-09-11T00:44:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efdd009a810 con 0x7efde01508b0 2024-09-11T00:44:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.931+0000 7efddde00640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efdc0077fc0 0x7efdc007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.932+0000 7efdde800640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7efdc0081730 0x7efdc0083b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.933+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9480c6bc0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.933+0000 7efdde800640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7efdc0081730 0x7efdc0083b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.933+0000 7efddde00640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efdc0077fc0 0x7efdc007a480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdcc033000 tx=0x7efdcc035040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.934+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== osd.6 v2:172.21.15.167:6810/3232528016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdc0084240 con 0x7efdc0081730 2024-09-11T00:44:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.937+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 --> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f8006c9e0 con 0x7f8f600822b0 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.935+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc93c012a10 con 0x7fc9480cb1d0 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.938+0000 7fc945600640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc928077fc0 0x7fc92807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.938+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc93c09a1d0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.938+0000 7fc945600640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7fc928081740 0x7fc928083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.938+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc93c015ec0 con 0x7fc928081740 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.938+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc93c09a6b0 con 0x7fc9480cb1d0 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.939+0000 7fc94de00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7fc928081740 0x7fc928083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.939+0000 7fc94ca00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc928077fc0 0x7fc92807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.939+0000 7f8f77e00640 1 -- 172.21.15.81:0/4267433583 <== osd.0 v2:172.21.15.81:6800/1565697795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8f8006c9e0 con 0x7f8f600822b0 2024-09-11T00:44:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7fc94de00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7fc928081740 0x7fc928083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7fc94ca00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc928077fc0 0x7fc92807a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc934033000 tx=0x7fc934004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f8f600822b0 msgr2=0x7f8f60084750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f8f600822b0 0x7f8f60084750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8f60077f70 msgr2=0x7f8f6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8f60077f70 0x7f8f6007a430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009fd0 tx=0x7f8f78009680 comp rx=0 tx=0).stop 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f800cd3c0 msgr2=0x7f8f800cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f85800640 1 --2- 172.21.15.81:0/4267433583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f800cd3c0 0x7f8f800cc200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c031000 tx=0x7f8f6c032c00 comp rx=0 tx=0).stop 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.940+0000 7f8f84e00640 1 -- 172.21.15.81:0/4267433583 reap_dead start 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.941+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 shutdown_connections 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.941+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 >> 172.21.15.81:0/4267433583 conn(0x7f8f8006f1f0 msgr2=0x7f8f800b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.941+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 shutdown_connections 2024-09-11T00:44:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.941+0000 7f8f85800640 1 -- 172.21.15.81:0/4267433583 wait complete. 2024-09-11T00:44:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.941+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== osd.7 v2:172.21.15.167:6826/2027890560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc93c015ec0 con 0x7fc928081740 2024-09-11T00:44:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.943+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 --> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ca40cbe50 con 0x7f6c84081770 2024-09-11T00:44:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.944+0000 7f6ca1600640 1 -- 172.21.15.81:0/1557078347 <== osd.1 v2:172.21.15.81:6816/1592127640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ca40cbe50 con 0x7f6c84081770 2024-09-11T00:44:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.945+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7f6c84081770 msgr2=0x7f6c84083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.945+0000 7f6cac400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7f6c84081770 0x7f6c84083bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.945+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6c84078070 msgr2=0x7f6c8407a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6cac400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6c84078070 0x7f6c8407a530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c98033000 tx=0x7f6c98004730 comp rx=0 tx=0).stop 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 msgr2=0x7f6ca41f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6cac400640 1 --2- 172.21.15.81:0/1557078347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ca40d0cc0 0x7f6ca41f83c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c700 tx=0x7f6c9c00cbc0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6caa400640 1 -- 172.21.15.81:0/1557078347 reap_dead start 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 shutdown_connections 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.946+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 >> 172.21.15.81:0/1557078347 conn(0x7f6ca406d570 msgr2=0x7f6ca414ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.948+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 shutdown_connections 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.948+0000 7f6cac400640 1 -- 172.21.15.81:0/1557078347 wait complete. 2024-09-11T00:44:46.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.952+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 --> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91700c8a70 con 0x7f9150081740 2024-09-11T00:44:46.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.952+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 --> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0e00367d0 con 0x7ff0c80818e0 2024-09-11T00:44:46.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.952+0000 7f9167e00640 1 -- 172.21.15.81:0/2858679599 <== osd.2 v2:172.21.15.81:6824/2087915132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91700c8a70 con 0x7f9150081740 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.953+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f9150081740 msgr2=0x7f9150083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.953+0000 7f9176a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f9150081740 0x7f9150083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9150077fc0 msgr2=0x7f915007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7f9176a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9150077fc0 0x7f915007a480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f915c033000 tx=0x7f915c02d000 comp rx=0 tx=0).stop 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 msgr2=0x7f9170153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7f9176a00640 1 --2- 172.21.15.81:0/2858679599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154004800 0x7f9170153fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f916800dd30 tx=0x7f916800b690 comp rx=0 tx=0).stop 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7f9174a00640 1 -- 172.21.15.81:0/2858679599 reap_dead start 2024-09-11T00:44:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.954+0000 7ff0de000640 1 -- 172.21.15.81:0/764179001 <== osd.3 v2:172.21.15.81:6801/3351502338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0e00367d0 con 0x7ff0c80818e0 2024-09-11T00:44:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7ff0c80818e0 msgr2=0x7ff0c8083d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7ff0c80818e0 0x7ff0c8083d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff0c8078170 msgr2=0x7ff0c807a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff0c8078170 0x7ff0c807a630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80046b0 tx=0x7ff0d8007e90 comp rx=0 tx=0).stop 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 msgr2=0x7ff0e00e1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 --2- 172.21.15.81:0/764179001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e004ef00 0x7ff0e00e1820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009980 tx=0x7ff0d4032cb0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e6800640 1 -- 172.21.15.81:0/764179001 reap_dead start 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 shutdown_connections 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.955+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 >> 172.21.15.81:0/764179001 conn(0x7ff0e0050ae0 msgr2=0x7ff0e004d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.956+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 shutdown_connections 2024-09-11T00:44:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.956+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 >> 172.21.15.81:0/2858679599 conn(0x7f9170070760 msgr2=0x7f9170152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.956+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 shutdown_connections 2024-09-11T00:44:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.957+0000 7ff0e7200640 1 -- 172.21.15.81:0/764179001 wait complete. 2024-09-11T00:44:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.957+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 shutdown_connections 2024-09-11T00:44:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.957+0000 7f9176a00640 1 -- 172.21.15.81:0/2858679599 wait complete. 2024-09-11T00:44:46.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.965+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 --> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efde00c80b0 con 0x7efdc0081730 2024-09-11T00:44:46.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.966+0000 7efdd6000640 1 -- 172.21.15.81:0/3731379290 <== osd.6 v2:172.21.15.167:6810/3232528016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efde00c80b0 con 0x7efdc0081730 2024-09-11T00:44:46.969 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:46.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:44:46.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.966+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7efdc0081730 msgr2=0x7efdc0083b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.966+0000 7efde5000640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7efdc0081730 0x7efdc0083b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 --> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1708002dd0 con 0x7f1714081690 2024-09-11T00:44:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efdc0077fc0 msgr2=0x7efdc007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efdc0077fc0 0x7efdc007a480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdcc033000 tx=0x7efdcc035040 comp rx=0 tx=0).stop 2024-09-11T00:44:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 msgr2=0x7efde0160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 --2- 172.21.15.81:0/3731379290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde01508b0 0x7efde0160420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b4a0 tx=0x7efdd000b960 comp rx=0 tx=0).stop 2024-09-11T00:44:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efdde800640 1 -- 172.21.15.81:0/3731379290 reap_dead start 2024-09-11T00:44:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 shutdown_connections 2024-09-11T00:44:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 >> 172.21.15.81:0/3731379290 conn(0x7efde00700f0 msgr2=0x7efde0154280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 --> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc94815a7d0 con 0x7fc928081740 2024-09-11T00:44:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.967+0000 7f1731600640 1 -- 172.21.15.81:0/1557672680 <== osd.4 v2:172.21.15.167:6802/2940055079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1708002dd0 con 0x7f1714081690 2024-09-11T00:44:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 shutdown_connections 2024-09-11T00:44:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7efde5000640 1 -- 172.21.15.81:0/3731379290 wait complete. 2024-09-11T00:44:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f1714081690 msgr2=0x7f1714083ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f1714081690 0x7f1714083ad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7fc945600640 1 -- 172.21.15.81:0/1008015921 <== osd.7 v2:172.21.15.167:6826/2027890560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc94815a7d0 con 0x7fc928081740 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1714077fa0 msgr2=0x7f171407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1714077fa0 0x7f171407a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1734151650 tx=0x7f1720009040 comp rx=0 tx=0).stop 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 msgr2=0x7f1734073910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f1726a00640 1 --2- 172.21.15.81:0/1557672680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1734074860 0x7f1734073910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1728000c00 tx=0x7f1728003820 comp rx=0 tx=0).stop 2024-09-11T00:44:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.968+0000 7f173a000640 1 -- 172.21.15.81:0/1557672680 reap_dead start 2024-09-11T00:44:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7fc928081740 msgr2=0x7fc928083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 shutdown_connections 2024-09-11T00:44:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 >> 172.21.15.81:0/1557672680 conn(0x7f17340700f0 msgr2=0x7f17341516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7fc928081740 0x7fc928083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc928077fc0 msgr2=0x7fc92807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc928077fc0 0x7fc92807a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc934033000 tx=0x7fc934004730 comp rx=0 tx=0).stop 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 msgr2=0x7fc9481f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 --2- 172.21.15.81:0/1008015921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9480cb1d0 0x7fc9481f5040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00c530 tx=0x7fc93c00c9f0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 shutdown_connections 2024-09-11T00:44:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94de00640 1 -- 172.21.15.81:0/1008015921 reap_dead start 2024-09-11T00:44:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7f1726a00640 1 -- 172.21.15.81:0/1557672680 wait complete. 2024-09-11T00:44:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 shutdown_connections 2024-09-11T00:44:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.969+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 >> 172.21.15.81:0/1008015921 conn(0x7fc94806d570 msgr2=0x7fc9480c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.978 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:46.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:44:46.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.973+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 --> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53a8073b70 con 0x7f5388081660 2024-09-11T00:44:46.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.973+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 shutdown_connections 2024-09-11T00:44:46.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.973+0000 7fc94fe00640 1 -- 172.21.15.81:0/1008015921 wait complete. 2024-09-11T00:44:46.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.975+0000 7f53a5600640 1 -- 172.21.15.81:0/2297081319 <== osd.5 v2:172.21.15.167:6818/3209520310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53a8073b70 con 0x7f5388081660 2024-09-11T00:44:46.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.977+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f5388081660 msgr2=0x7f5388083aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.977+0000 7f53b0200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f5388081660 0x7f5388083aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5388077f70 msgr2=0x7f538807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5388077f70 0x7f538807a430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f539c004ea0 tx=0x7f539c009040 comp rx=0 tx=0).stop 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80ca2b0 msgr2=0x7f53a80c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 --2- 172.21.15.81:0/2297081319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53a80ca2b0 0x7f53a80c5950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53a000ca00 tx=0x7f53a000cec0 comp rx=0 tx=0).stop 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53ae200640 1 -- 172.21.15.81:0/2297081319 reap_dead start 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 shutdown_connections 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 >> 172.21.15.81:0/2297081319 conn(0x7f53a80700f0 msgr2=0x7f53a81544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 shutdown_connections 2024-09-11T00:44:46.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:46.978+0000 7f53b0200640 1 -- 172.21.15.81:0/2297081319 wait complete. 2024-09-11T00:44:46.983 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:46.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:44:46.986 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:46.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:44:46.993 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-09-11T00:44:46.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:44:46.997 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:46.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:44:47.002 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-11T00:44:47.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:44:47.003 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:47.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:44:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.239+0000 7fca31200640 1 -- 172.21.15.81:0/2211126030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 msgr2=0x7fca2404acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.239+0000 7fca31200640 1 --2- 172.21.15.81:0/2211126030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca2404acf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0757b0 tx=0x7fca2c0a6930 comp rx=0 tx=0).stop 2024-09-11T00:44:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.239+0000 7fca31200640 1 -- 172.21.15.81:0/2211126030 shutdown_connections 2024-09-11T00:44:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.240+0000 7fca31200640 1 --2- 172.21.15.81:0/2211126030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404bcb0 0x7fca240d80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.240+0000 7fca31200640 1 --2- 172.21.15.81:0/2211126030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca2404acf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.240+0000 7fca31200640 1 --2- 172.21.15.81:0/2211126030 >> v2:172.21.15.81:3300/0 conn(0x7fca2404a910 0x7fca240def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.240+0000 7fca31200640 1 -- 172.21.15.81:0/2211126030 >> 172.21.15.81:0/2211126030 conn(0x7fca2404fc00 msgr2=0x7fca24050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.240+0000 7fca31200640 1 -- 172.21.15.81:0/2211126030 shutdown_connections 2024-09-11T00:44:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.241+0000 7fca31200640 1 -- 172.21.15.81:0/2211126030 wait complete. 2024-09-11T00:44:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.243+0000 7fca31200640 1 Processor -- start 2024-09-11T00:44:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 -- 172.21.15.81:0/1734613829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358153be0 msgr2=0x7f73580c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.244+0000 7fca31200640 1 -- start start 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 --2- 172.21.15.81:0/1734613829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358153be0 0x7f73580c79f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73580c6b90 tx=0x7f734802b2e0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 -- 172.21.15.81:0/1734613829 shutdown_connections 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 --2- 172.21.15.81:0/1734613829 >> v2:172.21.15.81:3300/0 conn(0x7f73580746d0 0x7f73580c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 --2- 172.21.15.81:0/1734613829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358153be0 0x7f73580c79f0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73580c6b90 tx=0x7f734802b2e0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.245+0000 7f735de00640 1 -- 172.21.15.81:0/1734613829 >> 172.21.15.81:0/1734613829 conn(0x7f735806c9e0 msgr2=0x7f735806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7f735de00640 1 -- 172.21.15.81:0/1734613829 shutdown_connections 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 0x7fca2404dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca240d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca240d85f0 con 0x7fca2404bcb0 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca24006140 con 0x7fca24050720 2024-09-11T00:44:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7fca31200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca240d8770 con 0x7fca2404a910 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.247+0000 7fca2b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.247+0000 7fca2b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:59882/0 (socket says 172.21.15.81:59882) 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.247+0000 7fca2b400640 1 -- 172.21.15.81:0/2196311952 learned_addr learned my addr 172.21.15.81:0/2196311952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.247+0000 7fca2aa00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 0x7fca2404dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.247+0000 7fca2be00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca240d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2b400640 1 -- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 msgr2=0x7fca240d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2b400640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca240d47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2b400640 1 -- 172.21.15.81:0/2196311952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 msgr2=0x7fca2404dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2b400640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 0x7fca2404dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2b400640 1 -- 172.21.15.81:0/2196311952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24179c80 con 0x7fca2404a910 2024-09-11T00:44:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.248+0000 7fca2aa00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 0x7fca2404dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.246+0000 7f735de00640 1 -- 172.21.15.81:0/1734613829 wait complete. 2024-09-11T00:44:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.249+0000 7fca2b400640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b440 tx=0x7fca2000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.249+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20015020 con 0x7fca2404a910 2024-09-11T00:44:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.249+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca20011980 con 0x7fca2404a910 2024-09-11T00:44:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.249+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20015020 con 0x7fca2404a910 2024-09-11T00:44:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.250+0000 7f735de00640 1 Processor -- start 2024-09-11T00:44:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.250+0000 7f735de00640 1 -- start start 2024-09-11T00:44:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.250+0000 7fca31200640 1 -- 172.21.15.81:0/2196311952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca240d5f10 con 0x7fca2404a910 2024-09-11T00:44:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.250+0000 7fca31200640 1 -- 172.21.15.81:0/2196311952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2417c2e0 con 0x7fca2404a910 2024-09-11T00:44:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.252+0000 7f735de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f735de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73580c7140 0x7f73580c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f735de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358142a60 0x7f7358142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f7356a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f7356a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60470/0 (socket says 172.21.15.81:60470) 2024-09-11T00:44:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7fca31200640 1 -- 172.21.15.81:0/2196311952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca240def70 con 0x7fca2404a910 2024-09-11T00:44:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f7356a00640 1 -- 172.21.15.81:0/3938155864 learned_addr learned my addr 172.21.15.81:0/3938155864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.253+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7358153fc0 con 0x7f73580746d0 2024-09-11T00:44:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.254+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7358074320 con 0x7f7358142a60 2024-09-11T00:44:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.254+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73580c92a0 con 0x7f73580c7140 2024-09-11T00:44:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7357400640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358142a60 0x7f7358142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7356a00640 1 -- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73580c7140 msgr2=0x7f73580c3720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7356a00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73580c7140 0x7f73580c3720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7356a00640 1 -- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358142a60 msgr2=0x7f7358142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7356a00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358142a60 0x7f7358142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.255+0000 7f7356a00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735815e990 con 0x7f73580746d0 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.256+0000 7f7356a00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f734802b850 tx=0x7f7348008c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.256+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca2001a410 con 0x7fca2404a910 2024-09-11T00:44:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.256+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348039050 con 0x7f73580746d0 2024-09-11T00:44:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.256+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7348003b00 con 0x7f73580746d0 2024-09-11T00:44:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.256+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7358149a90 con 0x7f73580746d0 2024-09-11T00:44:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.257+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73580c3200 con 0x7f73580746d0 2024-09-11T00:44:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.258+0000 7fca1f400640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 0x7fca0c07a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.258+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fca20099bb0 con 0x7fca2404a910 2024-09-11T00:44:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.257+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800a0d0 con 0x7f73580746d0 2024-09-11T00:44:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.258+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73580723a0 con 0x7f73580746d0 2024-09-11T00:44:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.262+0000 7fca2aa00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 0x7fca0c07a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.264+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca2001f070 con 0x7fca2404a910 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.262+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7348044070 con 0x7f73580746d0 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.264+0000 7f734f400640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 0x7f733407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.265+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f73480b9910 con 0x7f73580746d0 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.265+0000 7f7356000640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 0x7f733407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.266+0000 7f7356000640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 0x7f733407a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f73580c7ca0 tx=0x7f734000b370 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.266+0000 7fca2aa00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 0x7fca0c07a630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca24006630 tx=0x7fca2c0b8040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 -- 172.21.15.81:0/1636443982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5880c7bf0 msgr2=0x7ff588072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 --2- 172.21.15.81:0/1636443982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5880c7bf0 0x7ff588072650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5880762c0 tx=0x7ff57c02a4f0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 -- 172.21.15.81:0/1636443982 shutdown_connections 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 --2- 172.21.15.81:0/1636443982 >> v2:172.21.15.81:3300/0 conn(0x7ff588070c10 0x7ff588154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 --2- 172.21.15.81:0/1636443982 >> v2:172.21.15.167:3300/0 conn(0x7ff5880c7fd0 0x7ff5881543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.267+0000 7ff590000640 1 --2- 172.21.15.81:0/1636443982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5880c7bf0 0x7ff588072650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.268+0000 7ff590000640 1 -- 172.21.15.81:0/1636443982 >> 172.21.15.81:0/1636443982 conn(0x7ff5880700f0 msgr2=0x7ff588070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.268+0000 7ff590000640 1 -- 172.21.15.81:0/1636443982 shutdown_connections 2024-09-11T00:44:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.268+0000 7ff590000640 1 -- 172.21.15.81:0/1636443982 wait complete. 2024-09-11T00:44:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.269+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7348082240 con 0x7f73580746d0 2024-09-11T00:44:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.270+0000 7ff590000640 1 Processor -- start 2024-09-11T00:44:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.270+0000 7ff590000640 1 -- start start 2024-09-11T00:44:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.271+0000 7f5a25000640 1 -- 172.21.15.81:0/1921726948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18046400 msgr2=0x7f5a1804b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.271+0000 7f5a25000640 1 --2- 172.21.15.81:0/1921726948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18046400 0x7f5a1804b8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009830 tx=0x7f5a0c02a650 comp rx=0 tx=0).stop 2024-09-11T00:44:47.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7f5a25000640 1 -- 172.21.15.81:0/1921726948 shutdown_connections 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 0x7ff588153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff588073250 con 0x7ff5880c7fd0 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff58815b2f0 con 0x7ff5880c7bf0 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.272+0000 7ff590000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff58815a610 con 0x7ff588070c10 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7f5a25000640 1 --2- 172.21.15.81:0/1921726948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18046400 0x7f5a1804b8c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7f5a25000640 1 -- 172.21.15.81:0/1921726948 >> 172.21.15.81:0/1921726948 conn(0x7f5a1804fbd0 msgr2=0x7f5a1804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7ff58cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7ff58cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53410/0 (socket says 172.21.15.81:53410) 2024-09-11T00:44:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7ff58d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7ff58d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:59930/0 (socket says 172.21.15.81:59930) 2024-09-11T00:44:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.273+0000 7ff58d600640 1 -- 172.21.15.81:0/3687615832 learned_addr learned my addr 172.21.15.81:0/3687615832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.274+0000 7ff58e000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 0x7ff588153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58d600640 1 -- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 msgr2=0x7ff5881f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58d600640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7f5a25000640 1 -- 172.21.15.81:0/1921726948 shutdown_connections 2024-09-11T00:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58d600640 1 -- 172.21.15.81:0/3687615832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 msgr2=0x7ff588153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7f5a25000640 1 -- 172.21.15.81:0/1921726948 wait complete. 2024-09-11T00:44:47.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58d600640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 0x7ff588153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58d600640 1 -- 172.21.15.81:0/3687615832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5880c3450 con 0x7ff588070c10 2024-09-11T00:44:47.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.275+0000 7ff58e000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 0x7ff588153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:47.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7ff58cc00640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:47.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7fc06d000640 1 -- 172.21.15.81:0/2778704871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c004800 msgr2=0x7fc04c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7fc06d000640 1 --2- 172.21.15.81:0/2778704871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c004800 0x7fc04c004c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc058009b30 tx=0x7fc04c005830 comp rx=0 tx=0).stop 2024-09-11T00:44:47.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.276+0000 7ff58d600640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009850 tx=0x7ff57c004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7fc06d000640 1 -- 172.21.15.81:0/2778704871 shutdown_connections 2024-09-11T00:44:47.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7fc06d000640 1 --2- 172.21.15.81:0/2778704871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c004800 0x7fc04c004c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7fc06d000640 1 -- 172.21.15.81:0/2778704871 >> 172.21.15.81:0/2778704871 conn(0x7fc0680700f0 msgr2=0x7fc068070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c041070 con 0x7ff588070c10 2024-09-11T00:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c031a00 con 0x7ff588070c10 2024-09-11T00:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c031e30 con 0x7ff588070c10 2024-09-11T00:44:47.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7f3def200640 1 -- 172.21.15.81:0/1280467569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dcc0051c0 msgr2=0x7f3dcc0141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7f3def200640 1 --2- 172.21.15.81:0/1280467569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dcc0051c0 0x7f3dcc0141d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c6c0 tx=0x7f3dcc005830 comp rx=0 tx=0).stop 2024-09-11T00:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5881e4100 con 0x7ff588070c10 2024-09-11T00:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7f3ded200640 1 -- 172.21.15.81:0/1280467569 reap_dead start 2024-09-11T00:44:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5881e46a0 con 0x7ff588070c10 2024-09-11T00:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7f3def200640 1 -- 172.21.15.81:0/1280467569 shutdown_connections 2024-09-11T00:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7f3def200640 1 -- 172.21.15.81:0/1280467569 >> 172.21.15.81:0/1280467569 conn(0x7f3de80700f0 msgr2=0x7f3de8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7f3def200640 1 -- 172.21.15.81:0/1280467569 shutdown_connections 2024-09-11T00:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7fc06d000640 1 -- 172.21.15.81:0/2778704871 shutdown_connections 2024-09-11T00:44:47.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.277+0000 7fc06d000640 1 -- 172.21.15.81:0/2778704871 wait complete. 2024-09-11T00:44:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.280+0000 7fc06d000640 1 Processor -- start 2024-09-11T00:44:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.279+0000 7f3def200640 1 -- 172.21.15.81:0/1280467569 wait complete. 2024-09-11T00:44:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.281+0000 7f5a25000640 1 Processor -- start 2024-09-11T00:44:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.282+0000 7f5a25000640 1 -- start start 2024-09-11T00:44:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.280+0000 7fc06d000640 1 -- start start 2024-09-11T00:44:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.282+0000 7fc06d000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 0x7fc0681fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.282+0000 7fc06d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 0x7fc0681fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.282+0000 7fc06d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 0x7fc068200840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.280+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff588150860 con 0x7ff588070c10 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 0x7f5a18189650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 0x7f5a180f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1804aff0 con 0x7f5a18046400 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5a180061e0 con 0x7f5a18033c20 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7f5a25000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1804b170 con 0x7f5a180fcb30 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53434/0 (socket says 172.21.15.81:53434) 2024-09-11T00:44:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 -- 172.21.15.81:0/3108701417 learned_addr learned my addr 172.21.15.81:0/3108701417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f3def200640 1 Processor -- start 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7fc065e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 0x7fc0681fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7fc065e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 0x7fc0681fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53430/0 (socket says 172.21.15.81:53430) 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7fc065e00640 1 -- 172.21.15.81:0/530810910 learned_addr learned my addr 172.21.15.81:0/530810910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7fc065400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 0x7fc0681fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc06806ebd0 con 0x7fc0680c3370 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.283+0000 7fc066800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 0x7fc068200840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0680c83a0 con 0x7fc0681506a0 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc06806f5e0 con 0x7fc0681e4790 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1ea00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 0x7f5a18189650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1fe00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 0x7f5a180f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 -- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 msgr2=0x7f5a180f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 0x7f5a180f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.284+0000 7f5a1f400640 1 -- 172.21.15.81:0/3108701417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 msgr2=0x7f5a18189650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7f5a1f400640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 0x7f5a18189650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7fc065400640 1 -- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 msgr2=0x7fc068200840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7fc065400640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 0x7fc068200840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7fc065400640 1 -- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 msgr2=0x7fc0681fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7fc065400640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 0x7fc0681fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7fc065400640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0680c65a0 con 0x7fc0680c3370 2024-09-11T00:44:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7f3def200640 1 -- start start 2024-09-11T00:44:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7f5a1f400640 1 -- 172.21.15.81:0/3108701417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a180f7bc0 con 0x7f5a18033c20 2024-09-11T00:44:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.285+0000 7f5a1fe00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 0x7f5a180f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a1f400640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006b7b0 tx=0x7f5a2006de80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a1ea00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 0x7f5a18189650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7fc066800640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 0x7fc068200840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:47.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2007f070 con 0x7f5a18033c20 2024-09-11T00:44:47.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a200833b0 con 0x7f5a18033c20 2024-09-11T00:44:47.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a25000640 1 -- 172.21.15.81:0/3108701417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a18048bf0 con 0x7f5a18033c20 2024-09-11T00:44:47.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a25000640 1 -- 172.21.15.81:0/3108701417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a180491b0 con 0x7f5a18033c20 2024-09-11T00:44:47.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.287+0000 7fc065400640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 0x7fc0681fed60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0057c0 tx=0x7fc0580339b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.286+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20083800 con 0x7f5a18033c20 2024-09-11T00:44:47.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.287+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058038040 con 0x7fc0680c3370 2024-09-11T00:44:47.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0680cbc00 con 0x7fc0680c3370 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc068201520 con 0x7fc0680c3370 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 0x7f3de81572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de8155bb0 0x7f3de81ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3de8073250 con 0x7f3dcc0051c0 2024-09-11T00:44:47.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3de815b2f0 con 0x7f3de8155bb0 2024-09-11T00:44:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.288+0000 7f3def200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3de815a610 con 0x7f3de8150530 2024-09-11T00:44:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f3de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a200839a0 con 0x7f5a18033c20 2024-09-11T00:44:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f3de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60542/0 (socket says 172.21.15.81:60542) 2024-09-11T00:44:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f3de7e00640 1 -- 172.21.15.81:0/550849604 learned_addr learned my addr 172.21.15.81:0/550849604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f3de7400640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 0x7f3de81572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7f3de7400640 1 -- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de8155bb0 msgr2=0x7f3de81ef9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7f3de7400640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de8155bb0 0x7f3de81ef9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.289+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f4005290 con 0x7f5a18033c20 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc05802b9e0 con 0x7fc0680c3370 2024-09-11T00:44:47.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058038040 con 0x7fc0680c3370 2024-09-11T00:44:47.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7f3de7400640 1 -- 172.21.15.81:0/550849604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 msgr2=0x7f3de814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7f3de7400640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7f3de7400640 1 -- 172.21.15.81:0/550849604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de8159c30 con 0x7f3de8150530 2024-09-11T00:44:47.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f3de7e00640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:47.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f3de7400640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 0x7f3de81572e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c83e0 tx=0x7f3dd400ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f5a13400640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 0x7f5a0007e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5a20105010 con 0x7f5a18033c20 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400cc40 con 0x7f3de8150530 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dd4009e40 con 0x7f3de8150530 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.291+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4004280 con 0x7f3de8150530 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.292+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de80cbb40 con 0x7f3de8150530 2024-09-11T00:44:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.292+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de8156030 con 0x7f3de8150530 2024-09-11T00:44:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.292+0000 7f5a1ea00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 0x7f5a0007e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.290+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff57c046450 con 0x7ff588070c10 2024-09-11T00:44:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.292+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc040005290 con 0x7fc0680c3370 2024-09-11T00:44:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.293+0000 7f5a1ea00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 0x7f5a0007e940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c034000 tx=0x7f5a0c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.294+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de8072650 con 0x7f3de8150530 2024-09-11T00:44:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.296+0000 7ff585600640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 0x7ff56807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.296+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff57c0bb870 con 0x7ff588070c10 2024-09-11T00:44:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.296+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff5880c3450 con 0x7ff588070c10 2024-09-11T00:44:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.297+0000 7ff58cc00640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 0x7ff56807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.295+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc05803b070 con 0x7fc0680c3370 2024-09-11T00:44:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.297+0000 7fc05e000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 0x7fc04807a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.297+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc0580ba550 con 0x7fc0680c3370 2024-09-11T00:44:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.298+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3dd4039970 con 0x7f3de8150530 2024-09-11T00:44:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.298+0000 7fc065e00640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 0x7fc04807a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.298+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a200cd820 con 0x7f5a18033c20 2024-09-11T00:44:47.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.300+0000 7fc065e00640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 0x7fc04807a660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc068151130 tx=0x7fc0600021b0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.299+0000 7ff58cc00640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 0x7ff56807a430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff588159b30 tx=0x7ff57400b2e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.301+0000 7f3ddfe00640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 0x7f3dc807a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.301+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3dd409a7c0 con 0x7f3de8150530 2024-09-11T00:44:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.302+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3dd4062ff0 con 0x7f3de8150530 2024-09-11T00:44:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.302+0000 7f3de7e00640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 0x7f3dc807a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.305+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc0680c65a0 con 0x7fc0680c3370 2024-09-11T00:44:47.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.305+0000 7f3de7e00640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 0x7f3dc807a530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8011570 tx=0x7f3dd8009720 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc14e00640 1 -- 172.21.15.81:0/1555431856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100d0670 msgr2=0x7fbc100d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc0ca00640 1 -- 172.21.15.81:0/1555431856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08038070 con 0x7fbc100d0670 2024-09-11T00:44:47.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc14e00640 1 --2- 172.21.15.81:0/1555431856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100d0670 0x7fbc100d0a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005fd0 tx=0x7fbc0802abd0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc14e00640 1 -- 172.21.15.81:0/1555431856 shutdown_connections 2024-09-11T00:44:47.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc14e00640 1 --2- 172.21.15.81:0/1555431856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100d0670 0x7fbc100d0a80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.326+0000 7fbc14e00640 1 -- 172.21.15.81:0/1555431856 >> 172.21.15.81:0/1555431856 conn(0x7fbc1006d570 msgr2=0x7fbc1006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.327+0000 7fbc14e00640 1 -- 172.21.15.81:0/1555431856 shutdown_connections 2024-09-11T00:44:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.327+0000 7fbc14e00640 1 -- 172.21.15.81:0/1555431856 wait complete. 2024-09-11T00:44:47.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.331+0000 7fbc14e00640 1 Processor -- start 2024-09-11T00:44:47.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.331+0000 7fbc14e00640 1 -- start start 2024-09-11T00:44:47.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.333+0000 7fbc14e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.334+0000 7fbc14e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc100d0670 0x7fbc1014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.334+0000 7fbc0de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.334+0000 7fbc0de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60558/0 (socket says 172.21.15.81:60558) 2024-09-11T00:44:47.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.334+0000 7fbc0de00640 1 -- 172.21.15.81:0/320501866 learned_addr learned my addr 172.21.15.81:0/320501866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.334+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 0x7fbc10155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7fbc0d400640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc100d0670 0x7fbc1014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7f7be0c00640 1 -- 172.21.15.81:0/280598560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0c4f50 msgr2=0x7f7bdc15e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7f7be0c00640 1 --2- 172.21.15.81:0/280598560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0c4f50 0x7f7bdc15e560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005fd0 tx=0x7f7bd402aa80 comp rx=0 tx=0).stop 2024-09-11T00:44:47.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7fbc0e800640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 0x7fbc10155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1015e780 con 0x7fbc100cb1d0 2024-09-11T00:44:47.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1015e4a0 con 0x7fbc100d0670 2024-09-11T00:44:47.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.335+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc10154df0 con 0x7fbc10154a10 2024-09-11T00:44:47.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.336+0000 7fbc0de00640 1 -- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 msgr2=0x7fbc10155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7f7be0c00640 1 -- 172.21.15.81:0/280598560 shutdown_connections 2024-09-11T00:44:47.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7f7be0c00640 1 --2- 172.21.15.81:0/280598560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0c4f50 0x7f7bdc15e560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7f7be0c00640 1 --2- 172.21.15.81:0/280598560 >> v2:172.21.15.167:3300/0 conn(0x7f7bdc1548e0 0x7f7bdc15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7f7be0c00640 1 -- 172.21.15.81:0/280598560 >> 172.21.15.81:0/280598560 conn(0x7f7bdc06ebb0 msgr2=0x7f7bdc06efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.336+0000 7fbc0de00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 0x7fbc10155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.336+0000 7fbc0de00640 1 -- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc100d0670 msgr2=0x7fbc1014a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.336+0000 7fbc0de00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc100d0670 0x7fbc1014a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.336+0000 7fbc0de00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc101f4de0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7fbc0e800640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 0x7fbc10155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7fbc0de00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c400 tx=0x7fbc0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00017070 con 0x7fbc100cb1d0 2024-09-11T00:44:47.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc000053c0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.337+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00003850 con 0x7fbc100cb1d0 2024-09-11T00:44:47.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.340+0000 7f7be0c00640 1 -- 172.21.15.81:0/280598560 shutdown_connections 2024-09-11T00:44:47.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.340+0000 7f7be0c00640 1 -- 172.21.15.81:0/280598560 wait complete. 2024-09-11T00:44:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.340+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc10155680 con 0x7fbc100cb1d0 2024-09-11T00:44:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.340+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1014e6b0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.341+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc100cacf0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.346+0000 7f7be0c00640 1 Processor -- start 2024-09-11T00:44:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.347+0000 7f7be0c00640 1 -- start start 2024-09-11T00:44:47.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.349+0000 7f7be0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 0x7f7bdc1f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.349+0000 7f7be0c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 0x7f7bdc0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.349+0000 7f7be0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7be0c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc15dd60 con 0x7f7bdc0c4f50 2024-09-11T00:44:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7be0c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0cb280 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.349+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc000039f0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7be0c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc0cb5a0 con 0x7f7bdc1548e0 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7bdaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 0x7f7bdc0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60008/0 (socket says 172.21.15.81:60008) 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.350+0000 7f7bdbe00640 1 -- 172.21.15.81:0/937224971 learned_addr learned my addr 172.21.15.81:0/937224971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.351+0000 7f7bdb400640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 0x7f7bdc1f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.351+0000 7f7bdaa00640 1 -- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 msgr2=0x7f7bdc14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.351+0000 7f7bdaa00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.351+0000 7f7bdaa00640 1 -- 172.21.15.81:0/937224971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 msgr2=0x7f7bdc1f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.352+0000 7f7bdaa00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 0x7f7bdc1f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.352+0000 7f7bdaa00640 1 -- 172.21.15.81:0/937224971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc15c3b0 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.352+0000 7fbc06000640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.352+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbc00099d00 con 0x7fbc100cb1d0 2024-09-11T00:44:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.353+0000 7fbc0d400640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.353+0000 7f7bdb400640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 0x7f7bdc1f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.353+0000 7f7bdbe00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.354+0000 7f7bdaa00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 0x7f7bdc0b4c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c440 tx=0x7f7bcc00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.354+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.354+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc15d6d0 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.355+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc15bd40 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.355+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbc100cacf0 con 0x7fbc100cb1d0 2024-09-11T00:44:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.355+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc0035f0 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.355+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.356+0000 7fbc0d400640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 0x7fbbf007a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc100ca530 tx=0x7fbbfc009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.356+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb4005290 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.359+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7bcc037ac0 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.360+0000 7f7bd3400640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 0x7f7bbc07a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.361+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7bcc098fb0 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.362+0000 7f7bdb400640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 0x7f7bbc07a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.362+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7bcc061750 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.363+0000 7f7bdb400640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 0x7f7bbc07a630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8005fd0 tx=0x7f7bc800f360 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.688+0000 7fca31200640 1 -- 172.21.15.81:0/2196311952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fca2404b4a0 con 0x7fca2404a910 2024-09-11T00:44:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.689+0000 7fca1f400640 1 -- 172.21.15.81:0/2196311952 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca2000d040 con 0x7fca2404a910 2024-09-11T00:44:47.694 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-11T00:44:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.693+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 msgr2=0x7fca0c07a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.693+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 0x7fca0c07a630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca24006630 tx=0x7fca2c0b8040 comp rx=0 tx=0).stop 2024-09-11T00:44:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.693+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 msgr2=0x7fca24179740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.693+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b440 tx=0x7fca2000b900 comp rx=0 tx=0).stop 2024-09-11T00:44:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 shutdown_connections 2024-09-11T00:44:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca0c078170 0x7fca0c07a630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca24050720 0x7fca240d47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2404bcb0 0x7fca2404dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 --2- 172.21.15.81:0/2196311952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2404a910 0x7fca24179740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.694+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 >> 172.21.15.81:0/2196311952 conn(0x7fca2404fc00 msgr2=0x7fca240d73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.695+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 shutdown_connections 2024-09-11T00:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.695+0000 7fca1cc00640 1 -- 172.21.15.81:0/2196311952 wait complete. 2024-09-11T00:44:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.701+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f73580c77d0 con 0x7f73580746d0 2024-09-11T00:44:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.703+0000 7f734f400640 1 -- 172.21.15.81:0/3938155864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7348081b40 con 0x7f73580746d0 2024-09-11T00:44:47.709 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-11T00:44:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.707+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 msgr2=0x7f733407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.707+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 0x7f733407a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f73580c7ca0 tx=0x7f734000b370 comp rx=0 tx=0).stop 2024-09-11T00:44:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.707+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 msgr2=0x7f735814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.707+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f734802b850 tx=0x7f7348008c70 comp rx=0 tx=0).stop 2024-09-11T00:44:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 shutdown_connections 2024-09-11T00:44:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7334077fa0 0x7f733407a460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7358142a60 0x7f7358142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73580c7140 0x7f73580c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 --2- 172.21.15.81:0/3938155864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73580746d0 0x7f735814ca60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 >> 172.21.15.81:0/3938155864 conn(0x7f735806c9e0 msgr2=0x7f73581569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.708+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 shutdown_connections 2024-09-11T00:44:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.709+0000 7f735de00640 1 -- 172.21.15.81:0/3938155864 wait complete. 2024-09-11T00:44:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.723+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff588072630 con 0x7ff588070c10 2024-09-11T00:44:47.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-11T00:44:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.724+0000 7ff585600640 1 -- 172.21.15.81:0/3687615832 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff57c083be0 con 0x7ff588070c10 2024-09-11T00:44:47.727 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 msgr2=0x7ff56807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 0x7ff56807a430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff588159b30 tx=0x7ff57400b2e0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 msgr2=0x7ff5880afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009850 tx=0x7ff57c004260 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 shutdown_connections 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff568077f70 0x7ff56807a430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5880c7fd0 0x7ff588153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5880c7bf0 0x7ff5881f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 --2- 172.21.15.81:0/3687615832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff588070c10 0x7ff5880afa50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.728+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 >> 172.21.15.81:0/3687615832 conn(0x7ff5880700f0 msgr2=0x7ff588159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.729+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 shutdown_connections 2024-09-11T00:44:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.729+0000 7ff590000640 1 -- 172.21.15.81:0/3687615832 wait complete. 2024-09-11T00:44:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.733+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f59f4005580 con 0x7f5a18033c20 2024-09-11T00:44:47.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.734+0000 7f5a13400640 1 -- 172.21.15.81:0/3108701417 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a200cd120 con 0x7f5a18033c20 2024-09-11T00:44:47.736 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-11T00:44:47.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-11T00:44:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 msgr2=0x7f5a0007e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 0x7f5a0007e940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c034000 tx=0x7f5a0c004730 comp rx=0 tx=0).stop 2024-09-11T00:44:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 msgr2=0x7f5a180485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006b7b0 tx=0x7f5a2006de80 comp rx=0 tx=0).stop 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 shutdown_connections 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a0007c480 0x7f5a0007e940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a180fcb30 0x7f5a180f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a18046400 0x7f5a18189650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 --2- 172.21.15.81:0/3108701417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a18033c20 0x7f5a180485b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 >> 172.21.15.81:0/3108701417 conn(0x7f5a1804fbd0 msgr2=0x7f5a180fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 shutdown_connections 2024-09-11T00:44:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.737+0000 7f5a10c00640 1 -- 172.21.15.81:0/3108701417 wait complete. 2024-09-11T00:44:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.742+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3de81538d0 con 0x7f3de8150530 2024-09-11T00:44:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.742+0000 7f3ddfe00640 1 -- 172.21.15.81:0/550849604 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3dd40628f0 con 0x7f3de8150530 2024-09-11T00:44:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 msgr2=0x7f3dc807a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 0x7f3dc807a530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8011570 tx=0x7f3dd8009720 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 msgr2=0x7f3de81572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 0x7f3de81572e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c83e0 tx=0x7f3dd400ed80 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 shutdown_connections 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3dc8078070 0x7f3dc807a530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de8155bb0 0x7f3de81ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de8150530 0x7f3de81572e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 --2- 172.21.15.81:0/550849604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dcc0051c0 0x7f3de814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.746+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 >> 172.21.15.81:0/550849604 conn(0x7f3de80700f0 msgr2=0x7f3de80736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.747+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 shutdown_connections 2024-09-11T00:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.747+0000 7f3def200640 1 -- 172.21.15.81:0/550849604 wait complete. 2024-09-11T00:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.747+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc040005850 con 0x7fc0680c3370 2024-09-11T00:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.748+0000 7fc05e000640 1 -- 172.21.15.81:0/530810910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc058082730 con 0x7fc0680c3370 2024-09-11T00:44:47.751 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 msgr2=0x7fc04807a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 0x7fc04807a660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc068151130 tx=0x7fc0600021b0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 msgr2=0x7fc0681fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 0x7fc0681fed60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0057c0 tx=0x7fc0580339b0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 shutdown_connections 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc0480781a0 0x7fc04807a660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0681e4790 0x7fc068200840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0680c3370 0x7fc0681fed60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 --2- 172.21.15.81:0/530810910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0681506a0 0x7fc0681fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.750+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 >> 172.21.15.81:0/530810910 conn(0x7fc0680700f0 msgr2=0x7fc0681e6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.751+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 shutdown_connections 2024-09-11T00:44:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.751+0000 7fc06d000640 1 -- 172.21.15.81:0/530810910 wait complete. 2024-09-11T00:44:47.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-11T00:44:47.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-09-11T00:44:47.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.2 2024-09-11T00:44:47.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.770+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbc100cbe50 con 0x7fbc100cb1d0 2024-09-11T00:44:47.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.770+0000 7fbc06000640 1 -- 172.21.15.81:0/320501866 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbc00021020 con 0x7fbc100cb1d0 2024-09-11T00:44:47.773 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 msgr2=0x7fbbf007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 0x7fbbf007a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc100ca530 tx=0x7fbbfc009040 comp rx=0 tx=0).stop 2024-09-11T00:44:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 msgr2=0x7fbc10156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c400 tx=0x7fbc0000c8c0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 shutdown_connections 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc10154a10 0x7fbc10155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc100d0670 0x7fbc1014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 --2- 172.21.15.81:0/320501866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc100cb1d0 0x7fbc10156fb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 >> 172.21.15.81:0/320501866 conn(0x7fbc1006d570 msgr2=0x7fbc10150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 shutdown_connections 2024-09-11T00:44:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.773+0000 7fbc14e00640 1 -- 172.21.15.81:0/320501866 wait complete. 2024-09-11T00:44:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.774+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7bb4005850 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2024-09-11T00:44:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.774+0000 7f7bd3400640 1 -- 172.21.15.81:0/937224971 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7bcc068e20 con 0x7f7bdc0cbe90 2024-09-11T00:44:47.778 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 msgr2=0x7f7bbc07a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 0x7f7bbc07a630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8005fd0 tx=0x7f7bc800f360 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 msgr2=0x7f7bdc0b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 0x7f7bdc0b4c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c440 tx=0x7f7bcc00c840 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 shutdown_connections 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7bbc078170 0x7f7bbc07a630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc1548e0 0x7f7bdc14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc0cbe90 0x7f7bdc0b4c60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 --2- 172.21.15.81:0/937224971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bdc0c4f50 0x7f7bdc1f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 >> 172.21.15.81:0/937224971 conn(0x7f7bdc06ebb0 msgr2=0x7f7bdc158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 shutdown_connections 2024-09-11T00:44:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:47.777+0000 7f7be0c00640 1 -- 172.21.15.81:0/937224971 wait complete. 2024-09-11T00:44:47.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-09-11T00:44:47.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-09-11T00:44:48.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:44:48.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:44:48.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:44:48.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:44:48.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:44:48.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:44:48.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:44:48.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:44:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.963+0000 7f5a52600640 1 -- 172.21.15.81:0/3672685902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 msgr2=0x7f5a4404b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.964+0000 7f5a4b400640 1 -- 172.21.15.81:0/3672685902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40035020 con 0x7f5a4404ae30 2024-09-11T00:44:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.964+0000 7f5a52600640 1 --2- 172.21.15.81:0/3672685902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a4404b270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0511b0 tx=0x7f5a4002a530 comp rx=0 tx=0).stop 2024-09-11T00:44:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.964+0000 7f5a52600640 1 -- 172.21.15.81:0/3672685902 shutdown_connections 2024-09-11T00:44:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.965+0000 7f5a52600640 1 --2- 172.21.15.81:0/3672685902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a4404b270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.965+0000 7f5a52600640 1 --2- 172.21.15.81:0/3672685902 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440dfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.965+0000 7f5a52600640 1 -- 172.21.15.81:0/3672685902 >> 172.21.15.81:0/3672685902 conn(0x7f5a4404fc00 msgr2=0x7f5a44050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.965+0000 7f5a52600640 1 -- 172.21.15.81:0/3672685902 shutdown_connections 2024-09-11T00:44:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.966+0000 7f5a52600640 1 -- 172.21.15.81:0/3672685902 wait complete. 2024-09-11T00:44:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.969+0000 7f5a52600640 1 Processor -- start 2024-09-11T00:44:48.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.970+0000 7f5a52600640 1 -- start start 2024-09-11T00:44:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.972+0000 7f5a52600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.972+0000 7f5a52600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.973+0000 7f5a4be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.973+0000 7f5a4be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60576/0 (socket says 172.21.15.81:60576) 2024-09-11T00:44:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.973+0000 7f5a51200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.973+0000 7f5a4be00640 1 -- 172.21.15.81:0/3700955545 learned_addr learned my addr 172.21.15.81:0/3700955545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.973+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 0x7f5a441711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.974+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44007160 con 0x7f5a4404ae30 2024-09-11T00:44:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.974+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5a440dffe0 con 0x7f5a4404b7b0 2024-09-11T00:44:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.974+0000 7f5a51c00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 0x7f5a441711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.974+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5a440072e0 con 0x7f5a44006d80 2024-09-11T00:44:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.975+0000 7f5a4be00640 1 -- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 msgr2=0x7f5a440d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.975+0000 7f5a4be00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.975+0000 7f5a4be00640 1 -- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 msgr2=0x7f5a441711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.975+0000 7f5a4be00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 0x7f5a441711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.975+0000 7f5a4be00640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a440d3e70 con 0x7f5a4404ae30 2024-09-11T00:44:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.976+0000 7f5a51200640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.976+0000 7f5a51c00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 0x7f5a441711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.977+0000 7f5a4be00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a40006010 tx=0x7f5a400329d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.978+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4003f070 con 0x7f5a4404ae30 2024-09-11T00:44:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.978+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a40005630 con 0x7f5a4404ae30 2024-09-11T00:44:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.978+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40035030 con 0x7f5a4404ae30 2024-09-11T00:44:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.978+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a440d7e70 con 0x7f5a4404ae30 2024-09-11T00:44:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.978+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a440d9230 con 0x7f5a4404ae30 2024-09-11T00:44:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.980+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a440d7390 con 0x7f5a4404ae30 2024-09-11T00:44:48.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.983+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a40005220 con 0x7f5a4404ae30 2024-09-11T00:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.992+0000 7f5a48c00640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 0x7f5a3007a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.993+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5a400bb380 con 0x7f5a4404ae30 2024-09-11T00:44:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.995+0000 7f5a51200640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 0x7f5a3007a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.996+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a440d7390 con 0x7f5a4404ae30 2024-09-11T00:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:48.997+0000 7f5a51200640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 0x7f5a3007a530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0095d0 tx=0x7f5a3c005e50 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.030+0000 7f793e400640 1 -- 172.21.15.81:0/2182285459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d08e0 msgr2=0x7f79380cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.030+0000 7f793e400640 1 --2- 172.21.15.81:0/2182285459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d08e0 0x7f79380cc280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79380d1220 tx=0x7f792402a5b0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.031+0000 7f793e400640 1 -- 172.21.15.81:0/2182285459 shutdown_connections 2024-09-11T00:44:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.032+0000 7f793e400640 1 --2- 172.21.15.81:0/2182285459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.032+0000 7f793e400640 1 --2- 172.21.15.81:0/2182285459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d08e0 0x7f79380cc280 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.032+0000 7f793e400640 1 -- 172.21.15.81:0/2182285459 >> 172.21.15.81:0/2182285459 conn(0x7f793806d570 msgr2=0x7f793806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.032+0000 7f793e400640 1 -- 172.21.15.81:0/2182285459 shutdown_connections 2024-09-11T00:44:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.032+0000 7f793e400640 1 -- 172.21.15.81:0/2182285459 wait complete. 2024-09-11T00:44:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.036+0000 7ff4ff200640 1 -- 172.21.15.81:0/3114309843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c6fa0 msgr2=0x7ff50015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.036+0000 7ff4ff200640 1 --2- 172.21.15.81:0/3114309843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c6fa0 0x7ff50015aeb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff500069da0 tx=0x7ff4f002a580 comp rx=0 tx=0).stop 2024-09-11T00:44:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7ff4ff200640 1 -- 172.21.15.81:0/3114309843 shutdown_connections 2024-09-11T00:44:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7ff4ff200640 1 --2- 172.21.15.81:0/3114309843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c6fa0 0x7ff50015aeb0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff500069da0 tx=0x7ff4f002a580 comp rx=0 tx=0).stop 2024-09-11T00:44:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7ff4ff200640 1 -- 172.21.15.81:0/3114309843 >> 172.21.15.81:0/3114309843 conn(0x7ff50006ffd0 msgr2=0x7ff5000703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7f793e400640 1 Processor -- start 2024-09-11T00:44:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7ff4ff200640 1 -- 172.21.15.81:0/3114309843 shutdown_connections 2024-09-11T00:44:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.038+0000 7f793e400640 1 -- start start 2024-09-11T00:44:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.037+0000 7ff4ff200640 1 -- 172.21.15.81:0/3114309843 wait complete. 2024-09-11T00:44:49.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.040+0000 7ff4ff200640 1 Processor -- start 2024-09-11T00:44:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.040+0000 7f793e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.040+0000 7f793e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 0x7f79380b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.041+0000 7f7937400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.041+0000 7f7937400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60048/0 (socket says 172.21.15.81:60048) 2024-09-11T00:44:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.041+0000 7f7937400640 1 -- 172.21.15.81:0/2319268852 learned_addr learned my addr 172.21.15.81:0/2319268852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.041+0000 7f7936a00640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 0x7f79380b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d0cc0 0x7f7938155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f90b3e00640 1 -- 172.21.15.81:0/1962946079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac070c10 msgr2=0x7f90ac073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f90b3e00640 1 --2- 172.21.15.81:0/1962946079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac070c10 0x7f90ac073b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f909800a940 tx=0x7f909802a730 comp rx=0 tx=0).stop 2024-09-11T00:44:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f793815aee0 con 0x7f79380d0cc0 2024-09-11T00:44:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.040+0000 7ff4ff200640 1 -- start start 2024-09-11T00:44:49.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f793815e780 con 0x7f79380d08e0 2024-09-11T00:44:49.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f7937e00640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d0cc0 0x7f7938155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f793815b060 con 0x7f79380cb1d0 2024-09-11T00:44:49.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000c6bc0 0x7ff5000c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5000c3a80 0x7ff5000c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff50015d9e0 con 0x7ff5000c0eb0 2024-09-11T00:44:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5000c7e10 con 0x7ff5000c6bc0 2024-09-11T00:44:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4ff200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff500154a00 con 0x7ff5000c3a80 2024-09-11T00:44:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.042+0000 7ff4fde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60628/0 (socket says 172.21.15.81:60628) 2024-09-11T00:44:49.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 -- 172.21.15.81:0/2294290739 learned_addr learned my addr 172.21.15.81:0/2294290739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fd400640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000c6bc0 0x7ff5000c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 -- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5000c3a80 msgr2=0x7ff5000c3f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:44:49.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5000c3a80 0x7ff5000c3f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 -- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000c6bc0 msgr2=0x7ff5000c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000c6bc0 0x7ff5000c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7ff4fde00640 1 -- 172.21.15.81:0/2294290739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff500201500 con 0x7ff5000c0eb0 2024-09-11T00:44:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7f90b3e00640 1 -- 172.21.15.81:0/1962946079 shutdown_connections 2024-09-11T00:44:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.043+0000 7f90b3e00640 1 --2- 172.21.15.81:0/1962946079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac070c10 0x7f90ac073b70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f90b3e00640 1 -- 172.21.15.81:0/1962946079 >> 172.21.15.81:0/1962946079 conn(0x7f90ac0700f0 msgr2=0x7f90ac070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f7936a00640 1 -- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 msgr2=0x7f7938154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f7936a00640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f7936a00640 1 -- 172.21.15.81:0/2319268852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d0cc0 msgr2=0x7f7938155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f90b3e00640 1 -- 172.21.15.81:0/1962946079 shutdown_connections 2024-09-11T00:44:49.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f7936a00640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d0cc0 0x7f7938155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f7936a00640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7938155390 con 0x7f79380d08e0 2024-09-11T00:44:49.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7ff4fde00640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c460 tx=0x7ff4ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 -- 172.21.15.81:0/2189315219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800e1e30 msgr2=0x7f14800d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1485600640 1 -- 172.21.15.81:0/2189315219 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880af070 con 0x7f14800e1e30 2024-09-11T00:44:49.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 --2- 172.21.15.81:0/2189315219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800e1e30 0x7f14800d8520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f148806bbe0 tx=0x7f14880a69e0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f7936a00640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 0x7f79380b5600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f792800b3e0 tx=0x7f792800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.044+0000 7f90b3e00640 1 -- 172.21.15.81:0/1962946079 wait complete. 2024-09-11T00:44:49.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0052d0 con 0x7ff5000c0eb0 2024-09-11T00:44:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 -- 172.21.15.81:0/2189315219 shutdown_connections 2024-09-11T00:44:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 --2- 172.21.15.81:0/2189315219 >> v2:172.21.15.81:3300/0 conn(0x7f14800370c0 0x7f14800e2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 --2- 172.21.15.81:0/2189315219 >> v2:172.21.15.167:3300/0 conn(0x7f1480037610 0x7f14800d8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 --2- 172.21.15.81:0/2189315219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800e1e30 0x7f14800d8520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7f1487e00640 1 -- 172.21.15.81:0/2189315219 >> 172.21.15.81:0/2189315219 conn(0x7f1480053fa0 msgr2=0x7f1480054380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec005490 con 0x7ff5000c0eb0 2024-09-11T00:44:49.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec012870 con 0x7ff5000c0eb0 2024-09-11T00:44:49.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.045+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5002017a0 con 0x7ff5000c0eb0 2024-09-11T00:44:49.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.046+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5000c49e0 con 0x7ff5000c0eb0 2024-09-11T00:44:49.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.046+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928015020 con 0x7f79380d08e0 2024-09-11T00:44:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.047+0000 7f90b3e00640 1 Processor -- start 2024-09-11T00:44:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.047+0000 7f90b3e00640 1 -- start start 2024-09-11T00:44:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.047+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79381f99f0 con 0x7f79380d08e0 2024-09-11T00:44:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.047+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793814c410 con 0x7f79380d08e0 2024-09-11T00:44:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.048+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7928011920 con 0x7f79380d08e0 2024-09-11T00:44:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.048+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928015020 con 0x7f79380d08e0 2024-09-11T00:44:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.048+0000 7f1487e00640 1 -- 172.21.15.81:0/2189315219 shutdown_connections 2024-09-11T00:44:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.048+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50015aeb0 con 0x7ff5000c0eb0 2024-09-11T00:44:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.049+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7910005290 con 0x7f79380d08e0 2024-09-11T00:44:49.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.049+0000 7f90b3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.049+0000 7f90b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 0x7f90ac14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.048+0000 7f1487e00640 1 -- 172.21.15.81:0/2189315219 wait complete. 2024-09-11T00:44:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90ac1508b0 0x7f90ac06f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0c8680 con 0x7f90ac0c2f90 2024-09-11T00:44:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac150c90 con 0x7f90ac070c10 2024-09-11T00:44:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac0c8800 con 0x7f90ac1508b0 2024-09-11T00:44:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b1400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b1400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53522/0 (socket says 172.21.15.81:53522) 2024-09-11T00:44:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b1400640 1 -- 172.21.15.81:0/2544843061 learned_addr learned my addr 172.21.15.81:0/2544843061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.050+0000 7f90b1e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90ac1508b0 0x7f90ac06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.051+0000 7f90b0a00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 0x7f90ac14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.052+0000 7f90b1400640 1 -- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90ac1508b0 msgr2=0x7f90ac06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.052+0000 7f1487e00640 1 Processor -- start 2024-09-11T00:44:49.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.052+0000 7f90b1400640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90ac1508b0 0x7f90ac06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.052+0000 7f90b1400640 1 -- 172.21.15.81:0/2544843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 msgr2=0x7f90ac14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.053+0000 7f90b1400640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 0x7f90ac14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.053+0000 7f1487e00640 1 -- start start 2024-09-11T00:44:49.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.053+0000 7f90b1400640 1 -- 172.21.15.81:0/2544843061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac200dd0 con 0x7f90ac070c10 2024-09-11T00:44:49.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.053+0000 7f90b0a00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 0x7f90ac14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:44:49.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7928024480 con 0x7f79380d08e0 2024-09-11T00:44:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.054+0000 7f90b1400640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f909c00c3a0 tx=0x7f909c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.054+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c017070 con 0x7f90ac070c10 2024-09-11T00:44:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac2010b0 con 0x7f90ac070c10 2024-09-11T00:44:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac14c6d0 con 0x7f90ac070c10 2024-09-11T00:44:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909c0035f0 con 0x7f90ac070c10 2024-09-11T00:44:49.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.053+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff4ec012a10 con 0x7ff5000c0eb0 2024-09-11T00:44:49.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7ff4f6000640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 0x7ff4e007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff4ec099b70 con 0x7ff5000c0eb0 2024-09-11T00:44:49.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.055+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c003a40 con 0x7f90ac070c10 2024-09-11T00:44:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1480037610 0x7f14800d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14800e1e30 0x7f14800d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.057+0000 7ff4fd400640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 0x7ff4e007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14800e28d0 con 0x7f14800e1e30 2024-09-11T00:44:49.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14800e2750 con 0x7f1480037610 2024-09-11T00:44:49.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.056+0000 7f1487e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f14800e2a50 con 0x7f14800370c0 2024-09-11T00:44:49.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.057+0000 7f1486a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.057+0000 7f1486000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1480037610 0x7f14800d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.057+0000 7f1486a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60092/0 (socket says 172.21.15.81:60092) 2024-09-11T00:44:49.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.057+0000 7f1486a00640 1 -- 172.21.15.81:0/321580259 learned_addr learned my addr 172.21.15.81:0/321580259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f792f400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 0x7f791807a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f1486a00640 1 -- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1480037610 msgr2=0x7f14800d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f1486a00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1480037610 0x7f14800d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f1486a00640 1 -- 172.21.15.81:0/321580259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14800e1e30 msgr2=0x7f14800d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f792809a150 con 0x7f79380d08e0 2024-09-11T00:44:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.059+0000 7f7937400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 0x7f791807a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f1486a00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14800e1e30 0x7f14800d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.058+0000 7f1486a00640 1 -- 172.21.15.81:0/321580259 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148004d1f0 con 0x7f14800370c0 2024-09-11T00:44:49.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.059+0000 7ff4fd400640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 0x7ff4e007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0034000 tx=0x7ff4f0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.059+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f792801f020 con 0x7f79380d08e0 2024-09-11T00:44:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.059+0000 7f1486a00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1488051c90 tx=0x7f14880637c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.059+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9084005290 con 0x7f90ac070c10 2024-09-11T00:44:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.060+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880c3070 con 0x7f14800370c0 2024-09-11T00:44:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.060+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1488063a40 con 0x7f14800370c0 2024-09-11T00:44:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.060+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880af050 con 0x7f14800370c0 2024-09-11T00:44:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.061+0000 7f7937400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 0x7f791807a660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79240096c0 tx=0x7f7924004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.062+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148004d4d0 con 0x7f14800370c0 2024-09-11T00:44:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.062+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f148004da90 con 0x7f14800370c0 2024-09-11T00:44:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.060+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f909c003be0 con 0x7f90ac070c10 2024-09-11T00:44:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.062+0000 7f90a9600640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 0x7f908c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.062+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f909c099410 con 0x7f90ac070c10 2024-09-11T00:44:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.063+0000 7f90b0a00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 0x7f908c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.063+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff4ec062290 con 0x7ff5000c0eb0 2024-09-11T00:44:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.064+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14800d2190 con 0x7f14800370c0 2024-09-11T00:44:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.065+0000 7f90b0a00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 0x7f908c07a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9098034000 tx=0x7f9098004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.065+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f14880b4450 con 0x7f14800370c0 2024-09-11T00:44:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.066+0000 7f147ea00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 0x7f146407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.066+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f14881370d0 con 0x7f14800370c0 2024-09-11T00:44:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.067+0000 7f1486000640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 0x7f146407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.067+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f909c061580 con 0x7f90ac070c10 2024-09-11T00:44:49.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.068+0000 7f1486000640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 0x7f146407a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1480172390 tx=0x7f14700090e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.070+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f14880ff2b0 con 0x7f14800370c0 2024-09-11T00:44:49.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.113+0000 7f8359600640 1 -- 172.21.15.81:0/3736080725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c54d0 msgr2=0x7f83540d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.113+0000 7f8359600640 1 --2- 172.21.15.81:0/3736080725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c54d0 0x7f83540d0b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f834c005fd0 tx=0x7f834c02a970 comp rx=0 tx=0).stop 2024-09-11T00:44:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 -- 172.21.15.81:0/3736080725 shutdown_connections 2024-09-11T00:44:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 --2- 172.21.15.81:0/3736080725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c54d0 0x7f83540d0b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 --2- 172.21.15.81:0/3736080725 >> v2:172.21.15.167:3300/0 conn(0x7f83540c50b0 0x7f83540d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 -- 172.21.15.81:0/3736080725 >> 172.21.15.81:0/3736080725 conn(0x7f835406d570 msgr2=0x7f835406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 -- 172.21.15.81:0/3736080725 shutdown_connections 2024-09-11T00:44:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.114+0000 7f8359600640 1 -- 172.21.15.81:0/3736080725 wait complete. 2024-09-11T00:44:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.115+0000 7f0d5f200640 1 -- 172.21.15.81:0/3230612294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d5804b160 msgr2=0x7f0d580dfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.115+0000 7f0d5f200640 1 --2- 172.21.15.81:0/3230612294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d5804b160 0x7f0d580dfa80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009830 tx=0x7f0d5002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 -- 172.21.15.81:0/3230612294 shutdown_connections 2024-09-11T00:44:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 --2- 172.21.15.81:0/3230612294 >> v2:172.21.15.167:3300/0 conn(0x7f0d580dffc0 0x7f0d580e0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 --2- 172.21.15.81:0/3230612294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d5804b160 0x7f0d580dfa80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 -- 172.21.15.81:0/3230612294 >> 172.21.15.81:0/3230612294 conn(0x7f0d5804fc00 msgr2=0x7f0d58050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 -- 172.21.15.81:0/3686548398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 msgr2=0x7f69f8072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 --2- 172.21.15.81:0/3686548398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f8072650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69f80762c0 tx=0x7f69e802a420 comp rx=0 tx=0).stop 2024-09-11T00:44:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 -- 172.21.15.81:0/3686548398 shutdown_connections 2024-09-11T00:44:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 --2- 172.21.15.81:0/3686548398 >> v2:172.21.15.81:3300/0 conn(0x7f69f8070c10 0x7f69f8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 --2- 172.21.15.81:0/3686548398 >> v2:172.21.15.167:3300/0 conn(0x7f69f80c7fd0 0x7f69f81543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 --2- 172.21.15.81:0/3686548398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f8072650 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 -- 172.21.15.81:0/3686548398 >> 172.21.15.81:0/3686548398 conn(0x7f69f80700f0 msgr2=0x7f69f8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 -- 172.21.15.81:0/3686548398 shutdown_connections 2024-09-11T00:44:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f69ff200640 1 -- 172.21.15.81:0/3686548398 wait complete. 2024-09-11T00:44:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 -- 172.21.15.81:0/3230612294 shutdown_connections 2024-09-11T00:44:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.116+0000 7f0d5f200640 1 -- 172.21.15.81:0/3230612294 wait complete. 2024-09-11T00:44:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.117+0000 7f8359600640 1 Processor -- start 2024-09-11T00:44:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.117+0000 7f8359600640 1 -- start start 2024-09-11T00:44:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.119+0000 7f0d5f200640 1 Processor -- start 2024-09-11T00:44:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.119+0000 7f69ff200640 1 Processor -- start 2024-09-11T00:44:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.119+0000 7f69ff200640 1 -- start start 2024-09-11T00:44:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.119+0000 7f0d5f200640 1 -- start start 2024-09-11T00:44:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.120+0000 7f8359600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.120+0000 7f8359600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 0x7f83541f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69f8070c10 0x7f69f8141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80c7fd0 0x7f69f81533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8073250 con 0x7f69f80c7fd0 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69f815b2f0 con 0x7f69f8070c10 2024-09-11T00:44:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69ff200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69f815a610 con 0x7f69f80c7bf0 2024-09-11T00:44:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f0d5f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 0x7f0d5817c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f0d5f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 0x7f0d5804db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f0d5f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69f8070c10 0x7f69f8141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f8352000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 0x7f83541f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.121+0000 7f8352000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 0x7f83541f1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60650/0 (socket says 172.21.15.81:60650) 2024-09-11T00:44:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60140/0 (socket says 172.21.15.81:60140) 2024-09-11T00:44:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f8352a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f0d5e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f0d5e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60670/0 (socket says 172.21.15.81:60670) 2024-09-11T00:44:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f0d5e800640 1 -- 172.21.15.81:0/585584691 learned_addr learned my addr 172.21.15.81:0/585584691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 -- 172.21.15.81:0/2176541276 learned_addr learned my addr 172.21.15.81:0/2176541276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5804a910 con 0x7f0d580dffc0 2024-09-11T00:44:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d58032c10 con 0x7f0d5804b160 2024-09-11T00:44:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5804aa90 con 0x7f0d580d63c0 2024-09-11T00:44:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 -- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69f8070c10 msgr2=0x7f69f8141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69f8070c10 0x7f69f8141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 -- 172.21.15.81:0/2176541276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80c7fd0 msgr2=0x7f69f81533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80c7fd0 0x7f69f81533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.122+0000 7f69efe00640 1 -- 172.21.15.81:0/2176541276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f813f780 con 0x7f69f80c7bf0 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f69efe00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69e000e790 tx=0x7f69e000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f8352a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60124/0 (socket says 172.21.15.81:60124) 2024-09-11T00:44:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f8352000640 1 -- 172.21.15.81:0/1392900392 learned_addr learned my addr 172.21.15.81:0/1392900392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540b51d0 0x7f83541e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f0d5de00640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 0x7f0d5817c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8354154ef0 con 0x7f8354154b10 2024-09-11T00:44:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f8353400640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540b51d0 0x7f83541e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f0d5e800640 1 -- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 msgr2=0x7f0d5804db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f835415b1f0 con 0x7f83540b51d0 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f835415dea0 con 0x7f83540c50b0 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e000eea0 con 0x7f69f80c7bf0 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e000ccc0 con 0x7f69f80c7bf0 2024-09-11T00:44:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0005280 con 0x7f69f80c7bf0 2024-09-11T00:44:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f8150520 con 0x7f69f80c7bf0 2024-09-11T00:44:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f8140ff0 con 0x7f69f80c7bf0 2024-09-11T00:44:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.123+0000 7f0d5d400640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 0x7f0d5804db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f0d5e800640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 0x7f0d5804db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f0d5e800640 1 -- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 msgr2=0x7f0d5817c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f0d5e800640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 0x7f0d5817c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.124+0000 7f0d5e800640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d58046260 con 0x7f0d580dffc0 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f0d5de00640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 0x7f0d5817c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.126+0000 7f0d5d400640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 0x7f0d5804db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f8352a00640 1 -- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540b51d0 msgr2=0x7f83541e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f8352a00640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540b51d0 0x7f83541e5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f8352a00640 1 -- 172.21.15.81:0/1392900392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 msgr2=0x7f83541f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.126+0000 7f0d5e800640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00e740 tx=0x7f0d4c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f8352a00640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 0x7f83541f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.125+0000 7f8352a00640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8354149050 con 0x7f83540c50b0 2024-09-11T00:44:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.126+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00ccc0 con 0x7f0d580dffc0 2024-09-11T00:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f8352a00640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f834400c3f0 tx=0x7f834400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5817c9c0 con 0x7f0d580dffc0 2024-09-11T00:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d580d5610 con 0x7f0d580dffc0 2024-09-11T00:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d4c00ee50 con 0x7f0d580dffc0 2024-09-11T00:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00ce60 con 0x7f0d580dffc0 2024-09-11T00:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344011790 con 0x7f83540c50b0 2024-09-11T00:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8344017070 con 0x7f83540c50b0 2024-09-11T00:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344011ce0 con 0x7f83540c50b0 2024-09-11T00:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.127+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f80c24e0 con 0x7f69f80c7bf0 2024-09-11T00:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.130+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f69e0005420 con 0x7f69f80c7bf0 2024-09-11T00:44:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.128+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83540b6030 con 0x7f83540c50b0 2024-09-11T00:44:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.128+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83540b5d50 con 0x7f83540c50b0 2024-09-11T00:44:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.130+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d38005290 con 0x7f0d580dffc0 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.132+0000 7f69f4c00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 0x7f69d407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.132+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f69e009a800 con 0x7f69f80c7bf0 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.132+0000 7f69f7e00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 0x7f69d407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.131+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835415e3c0 con 0x7f83540c50b0 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.133+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f834401c460 con 0x7f83540c50b0 2024-09-11T00:44:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.134+0000 7f69f7e00640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 0x7f69d407a480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69e8034000 tx=0x7f69e8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.134+0000 7f834aa00640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 0x7f833407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.135+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8344099dd0 con 0x7f83540c50b0 2024-09-11T00:44:49.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.135+0000 7f8352000640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 0x7f833407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.132+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0d4c005280 con 0x7f0d580dffc0 2024-09-11T00:44:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.136+0000 7f8352000640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 0x7f833407a500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8354151820 tx=0x7f8340005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.137+0000 7f0d56000640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 0x7f0d4007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.137+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0d4c09a910 con 0x7f0d580dffc0 2024-09-11T00:44:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.137+0000 7f0d5de00640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 0x7f0d4007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.138+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69e0063130 con 0x7f69f80c7bf0 2024-09-11T00:44:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.138+0000 7f0d5de00640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 0x7f0d4007a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d6006b710 tx=0x7f0d6006f040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.141+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0d4c062fa0 con 0x7f0d580dffc0 2024-09-11T00:44:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.142+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f834409d030 con 0x7f83540c50b0 2024-09-11T00:44:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.433+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5a44000d00 con 0x7f5a4404ae30 2024-09-11T00:44:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.434+0000 7f5a48c00640 1 -- 172.21.15.81:0/3700955545 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a40049030 con 0x7f5a4404ae30 2024-09-11T00:44:49.437 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.439+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 msgr2=0x7f5a3007a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.439+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 0x7f5a3007a530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0095d0 tx=0x7f5a3c005e50 comp rx=0 tx=0).stop 2024-09-11T00:44:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.439+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 msgr2=0x7f5a440d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.439+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a40006010 tx=0x7f5a400329d0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.440+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 shutdown_connections 2024-09-11T00:44:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.440+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5a30078070 0x7f5a3007a530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.440+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4404b7b0 0x7f5a441711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.440+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4404ae30 0x7f5a440d4170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.441+0000 7f5a52600640 1 --2- 172.21.15.81:0/3700955545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a44006d80 0x7f5a440d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.441+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 >> 172.21.15.81:0/3700955545 conn(0x7f5a4404fc00 msgr2=0x7f5a4404ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.441+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 shutdown_connections 2024-09-11T00:44:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.441+0000 7f5a52600640 1 -- 172.21.15.81:0/3700955545 wait complete. 2024-09-11T00:44:49.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-11T00:44:49.470 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.484+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff500075160 con 0x7ff5000c0eb0 2024-09-11T00:44:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.484+0000 7ff4f6000640 1 -- 172.21.15.81:0/2294290739 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4ec062290 con 0x7ff5000c0eb0 2024-09-11T00:44:49.487 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 msgr2=0x7ff4e007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 0x7ff4e007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0034000 tx=0x7ff4f0004730 comp rx=0 tx=0).stop 2024-09-11T00:44:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 msgr2=0x7ff5000c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c460 tx=0x7ff4ec00c920 comp rx=0 tx=0).stop 2024-09-11T00:44:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 shutdown_connections 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff4e0077fa0 0x7ff4e007a460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff5000c3a80 0x7ff5000c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000c6bc0 0x7ff5000c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 --2- 172.21.15.81:0/2294290739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5000c0eb0 0x7ff5000c9c30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 >> 172.21.15.81:0/2294290739 conn(0x7ff50006ffd0 msgr2=0x7ff500158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 shutdown_connections 2024-09-11T00:44:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.487+0000 7ff4ff200640 1 -- 172.21.15.81:0/2294290739 wait complete. 2024-09-11T00:44:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.497+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9084005850 con 0x7f90ac070c10 2024-09-11T00:44:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.498+0000 7f90a9600640 1 -- 172.21.15.81:0/2544843061 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f909c065fb0 con 0x7f90ac070c10 2024-09-11T00:44:49.500 INFO:teuthology.orchestra.run.smithi081.stdout:55834574860 2024-09-11T00:44:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.502+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 msgr2=0x7f908c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.502+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 0x7f908c07a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9098034000 tx=0x7f9098004730 comp rx=0 tx=0).stop 2024-09-11T00:44:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.502+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 msgr2=0x7f90ac1fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.502+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f909c00c3a0 tx=0x7f909c00c860 comp rx=0 tx=0).stop 2024-09-11T00:44:49.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 shutdown_connections 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f908c077f70 0x7f908c07a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90ac1508b0 0x7f90ac06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90ac0c2f90 0x7f90ac14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 --2- 172.21.15.81:0/2544843061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90ac070c10 0x7f90ac1fcd40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.503+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 >> 172.21.15.81:0/2544843061 conn(0x7f90ac0700f0 msgr2=0x7f90ac1559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.504+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 shutdown_connections 2024-09-11T00:44:49.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.504+0000 7f90b3e00640 1 -- 172.21.15.81:0/2544843061 wait complete. 2024-09-11T00:44:49.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.2 2024-09-11T00:44:49.509 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.507+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7910005850 con 0x7f79380d08e0 2024-09-11T00:44:49.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.508+0000 7f792f400640 1 -- 172.21.15.81:0/2319268852 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7928062330 con 0x7f79380d08e0 2024-09-11T00:44:49.510 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-11T00:44:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.511+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 msgr2=0x7f791807a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.511+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 0x7f791807a660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79240096c0 tx=0x7f7924004730 comp rx=0 tx=0).stop 2024-09-11T00:44:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 msgr2=0x7f79380b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 0x7f79380b5600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f792800b3e0 tx=0x7f792800b8a0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 shutdown_connections 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f79180781a0 0x7f791807a660 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d0cc0 0x7f7938155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79380d08e0 0x7f79380b5600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 --2- 172.21.15.81:0/2319268852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79380cb1d0 0x7f7938154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 >> 172.21.15.81:0/2319268852 conn(0x7f793806d570 msgr2=0x7f793806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 shutdown_connections 2024-09-11T00:44:49.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.512+0000 7f793e400640 1 -- 172.21.15.81:0/2319268852 wait complete. 2024-09-11T00:44:49.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.515+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1480053c60 con 0x7f14800370c0 2024-09-11T00:44:49.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.516+0000 7f147ea00640 1 -- 172.21.15.81:0/321580259 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1488103ce0 con 0x7f14800370c0 2024-09-11T00:44:49.519 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 msgr2=0x7f146407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 0x7f146407a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1480172390 tx=0x7f14700090e0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 msgr2=0x7f14800d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1488051c90 tx=0x7f14880637c0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 shutdown_connections 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1464077fc0 0x7f146407a480 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1480172390 tx=0x7f14700090e0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14800e1e30 0x7f14800d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1480037610 0x7f14800d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 --2- 172.21.15.81:0/321580259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14800370c0 0x7f14800d0510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 >> 172.21.15.81:0/321580259 conn(0x7f1480053fa0 msgr2=0x7f14800d82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.520+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 shutdown_connections 2024-09-11T00:44:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.521+0000 7f1487e00640 1 -- 172.21.15.81:0/321580259 wait complete. 2024-09-11T00:44:49.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.4 2024-09-11T00:44:49.533 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-09-11T00:44:49.538 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-09-11T00:44:49.542 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.545+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8354151220 con 0x7f83540c50b0 2024-09-11T00:44:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.546+0000 7f834aa00640 1 -- 172.21.15.81:0/1392900392 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8344062570 con 0x7f83540c50b0 2024-09-11T00:44:49.549 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 msgr2=0x7f833407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 0x7f833407a500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8354151820 tx=0x7f8340005f90 comp rx=0 tx=0).stop 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 msgr2=0x7f83541f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f834400c3f0 tx=0x7f834400c8b0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 shutdown_connections 2024-09-11T00:44:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8334078040 0x7f833407a500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540b51d0 0x7f83541e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354154b10 0x7f83541f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.548+0000 7f8359600640 1 --2- 172.21.15.81:0/1392900392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540c50b0 0x7f83541f4a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.549+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 >> 172.21.15.81:0/1392900392 conn(0x7f835406d570 msgr2=0x7f835414af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.549+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 shutdown_connections 2024-09-11T00:44:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.549+0000 7f8359600640 1 -- 172.21.15.81:0/1392900392 wait complete. 2024-09-11T00:44:49.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.6 2024-09-11T00:44:49.567 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.571+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f69f8072630 con 0x7f69f80c7bf0 2024-09-11T00:44:49.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.571+0000 7f69f4c00640 1 -- 172.21.15.81:0/2176541276 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69e0062a30 con 0x7f69f80c7bf0 2024-09-11T00:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-11T00:44:49.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 msgr2=0x7f69d407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 0x7f69d407a480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69e8034000 tx=0x7f69e8004730 comp rx=0 tx=0).stop 2024-09-11T00:44:49.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 msgr2=0x7f69f80b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69e000e790 tx=0x7f69e000ec50 comp rx=0 tx=0).stop 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 shutdown_connections 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f69d4077fc0 0x7f69d407a480 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80c7fd0 0x7f69f81533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69f80c7bf0 0x7f69f80b0900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 --2- 172.21.15.81:0/2176541276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69f8070c10 0x7f69f8141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 >> 172.21.15.81:0/2176541276 conn(0x7f69f80700f0 msgr2=0x7f69f81595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 shutdown_connections 2024-09-11T00:44:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f69ff200640 1 -- 172.21.15.81:0/2176541276 wait complete. 2024-09-11T00:44:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.574+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0d38005580 con 0x7f0d580dffc0 2024-09-11T00:44:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.575+0000 7f0d56000640 1 -- 172.21.15.81:0/585584691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d4c0628a0 con 0x7f0d580dffc0 2024-09-11T00:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 msgr2=0x7f0d4007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 0x7f0d4007a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d6006b710 tx=0x7f0d6006f040 comp rx=0 tx=0).stop 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 msgr2=0x7f0d5804e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00e740 tx=0x7f0d4c00ec00 comp rx=0 tx=0).stop 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 shutdown_connections 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0d40077f70 0x7f0d4007a430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d580dffc0 0x7f0d5804e040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d580d63c0 0x7f0d5804db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 --2- 172.21.15.81:0/585584691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d5804b160 0x7f0d5817c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 >> 172.21.15.81:0/585584691 conn(0x7f0d5804fc00 msgr2=0x7f0d580d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 shutdown_connections 2024-09-11T00:44:49.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.577+0000 7f0d5f200640 1 -- 172.21.15.81:0/585584691 wait complete. 2024-09-11T00:44:49.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2024-09-11T00:44:49.593 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.7 2024-09-11T00:44:49.597 DEBUG:teuthology.parallel:result is None 2024-09-11T00:44:49.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:44:49.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:49.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.792+0000 7f127cc00640 1 -- 172.21.15.81:0/1647093560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 msgr2=0x7f127806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.792+0000 7f127cc00640 1 --2- 172.21.15.81:0/1647093560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f127806d450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f127806d0c0 tx=0x7f126802a560 comp rx=0 tx=0).stop 2024-09-11T00:44:49.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.792+0000 7f127cc00640 1 -- 172.21.15.81:0/1647093560 shutdown_connections 2024-09-11T00:44:49.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.792+0000 7f127cc00640 1 --2- 172.21.15.81:0/1647093560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 0x7f127815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.793+0000 7f127cc00640 1 --2- 172.21.15.81:0/1647093560 >> v2:172.21.15.167:3300/0 conn(0x7f12780b1f10 0x7f12780745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.793+0000 7f127cc00640 1 --2- 172.21.15.81:0/1647093560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f127806d450 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.793+0000 7f127cc00640 1 -- 172.21.15.81:0/1647093560 >> 172.21.15.81:0/1647093560 conn(0x7f127806ffd0 msgr2=0x7f12780703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.793+0000 7f127cc00640 1 -- 172.21.15.81:0/1647093560 shutdown_connections 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.793+0000 7f127cc00640 1 -- 172.21.15.81:0/1647093560 wait complete. 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.794+0000 7f127cc00640 1 Processor -- start 2024-09-11T00:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.794+0000 7f127cc00640 1 -- start start 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 0x7f12781f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b1f10 0x7f12781f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12780c7040 con 0x7f127814ebc0 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12781581a0 con 0x7f12780b1f10 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f127cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f127814efa0 con 0x7f1278074b30 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f1277e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f1277e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60688/0 (socket says 172.21.15.81:60688) 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.795+0000 7f1277e00640 1 -- 172.21.15.81:0/3292330957 learned_addr learned my addr 172.21.15.81:0/3292330957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277400640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 0x7f12781f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1276a00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b1f10 0x7f12781f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 -- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 msgr2=0x7f12781f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 0x7f12781f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 -- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b1f10 msgr2=0x7f12781f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b1f10 0x7f12781f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 -- 172.21.15.81:0/3292330957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12780ae8c0 con 0x7f127814ebc0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f1277e00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f127000b9a0 tx=0x7f127000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270019070 con 0x7f127814ebc0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f127000cbb0 con 0x7f127814ebc0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270014440 con 0x7f127814ebc0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.796+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12780aeb80 con 0x7f127814ebc0 2024-09-11T00:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.797+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781f4850 con 0x7f127814ebc0 2024-09-11T00:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.798+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127806f970 con 0x7f127814ebc0 2024-09-11T00:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.799+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f127001d3b0 con 0x7f127814ebc0 2024-09-11T00:44:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.799+0000 7f126f400640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 0x7f125807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.800+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1270099fb0 con 0x7f127814ebc0 2024-09-11T00:44:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.800+0000 7f1277400640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 0x7f125807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.801+0000 7f1277400640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 0x7f125807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1268033000 tx=0x7f1268004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.804+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f127806f970 con 0x7f127814ebc0 2024-09-11T00:44:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.984+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12780c72b0 con 0x7f1258077f70 2024-09-11T00:44:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.991+0000 7f126f400640 1 -- 172.21.15.81:0/3292330957 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332593 (secure 0 0 0) 0x7f12780c72b0 con 0x7f1258077f70 2024-09-11T00:44:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 msgr2=0x7f125807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 0x7f125807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1268033000 tx=0x7f1268004730 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 msgr2=0x7f12780b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f127000b9a0 tx=0x7f127000bda0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 shutdown_connections 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1258077f70 0x7f125807a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127814ebc0 0x7f12780b0ac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12780b1f10 0x7f12781f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 --2- 172.21.15.81:0/3292330957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1278074b30 0x7f12781f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 >> 172.21.15.81:0/3292330957 conn(0x7f127806ffd0 msgr2=0x7f12780c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 shutdown_connections 2024-09-11T00:44:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:49.996+0000 7f127cc00640 1 -- 172.21.15.81:0/3292330957 wait complete. 2024-09-11T00:44:50.013 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-11T00:44:49.819980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003622"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:50.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 -- 172.21.15.81:0/3228693227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda3c003a50 msgr2=0x7fda3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 --2- 172.21.15.81:0/3228693227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda3c003a50 0x7fda3c003e70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda4800a6c0 tx=0x7fda3c005830 comp rx=0 tx=0).stop 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5d400640 1 -- 172.21.15.81:0/3228693227 reap_dead start 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 -- 172.21.15.81:0/3228693227 shutdown_connections 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 -- 172.21.15.81:0/3228693227 >> 172.21.15.81:0/3228693227 conn(0x7fda580700f0 msgr2=0x7fda58070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 -- 172.21.15.81:0/3228693227 shutdown_connections 2024-09-11T00:44:50.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.211+0000 7fda5f400640 1 -- 172.21.15.81:0/3228693227 wait complete. 2024-09-11T00:44:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.213+0000 7fda5f400640 1 Processor -- start 2024-09-11T00:44:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.213+0000 7fda5f400640 1 -- start start 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda3c003a50 0x7fda581ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 0x7fda5806e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda58156640 con 0x7fda58147df0 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda58150c90 con 0x7fda5806e2d0 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda581567c0 con 0x7fda3c003a50 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60700/0 (socket says 172.21.15.81:60700) 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 -- 172.21.15.81:0/3269811488 learned_addr learned my addr 172.21.15.81:0/3269811488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5ca00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda3c003a50 0x7fda581ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5d400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 0x7fda5806e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 -- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda3c003a50 msgr2=0x7fda581ef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda3c003a50 0x7fda581ef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 -- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 msgr2=0x7fda5806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 0x7fda5806e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda57e00640 1 -- 172.21.15.81:0/3269811488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda581f01d0 con 0x7fda58147df0 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.214+0000 7fda5d400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 0x7fda5806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda57e00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fda44006450 tx=0x7fda440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44015070 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda440119c0 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44011df0 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5806ec90 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.215+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda581f0440 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.216+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda58072630 con 0x7fda58147df0 2024-09-11T00:44:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.217+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda440103c0 con 0x7fda58147df0 2024-09-11T00:44:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.218+0000 7fda54c00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 0x7fda3807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.218+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fda4409b0b0 con 0x7fda58147df0 2024-09-11T00:44:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.219+0000 7fda5ca00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 0x7fda3807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.219+0000 7fda5ca00640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 0x7fda3807a460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda4800a6c0 tx=0x7fda4802c040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:50.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.222+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fda5806ec90 con 0x7fda58147df0 2024-09-11T00:44:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.402+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda5814f280 con 0x7fda38077fa0 2024-09-11T00:44:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.408+0000 7fda54c00640 1 -- 172.21.15.81:0/3269811488 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332593 (secure 0 0 0) 0x7fda5814f280 con 0x7fda38077fa0 2024-09-11T00:44:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:50.416 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:50.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 msgr2=0x7fda3807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 0x7fda3807a460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda4800a6c0 tx=0x7fda4802c040 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 msgr2=0x7fda58148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fda44006450 tx=0x7fda440039c0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 shutdown_connections 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda38077fa0 0x7fda3807a460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda5806e2d0 0x7fda5806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58147df0 0x7fda58148210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 --2- 172.21.15.81:0/3269811488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda3c003a50 0x7fda581ef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 >> 172.21.15.81:0/3269811488 conn(0x7fda580700f0 msgr2=0x7fda580c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.412+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 shutdown_connections 2024-09-11T00:44:50.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.413+0000 7fda5f400640 1 -- 172.21.15.81:0/3269811488 wait complete. 2024-09-11T00:44:50.431 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-11T00:44:49.819980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003622"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:50.436 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:44:50.436 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:44:50.436 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:44:50.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 -- 172.21.15.81:0/3392866258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb128074860 msgr2=0x7fb1280c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 --2- 172.21.15.81:0/3392866258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb128074860 0x7fb1280c7980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1280b2270 tx=0x7fb11402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 -- 172.21.15.81:0/3392866258 shutdown_connections 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 --2- 172.21.15.81:0/3392866258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb128074860 0x7fb1280c7980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 --2- 172.21.15.81:0/3392866258 >> v2:172.21.15.167:3300/0 conn(0x7fb128152610 0x7fb1280c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 -- 172.21.15.81:0/3392866258 >> 172.21.15.81:0/3392866258 conn(0x7fb1280700f0 msgr2=0x7fb128070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 -- 172.21.15.81:0/3392866258 shutdown_connections 2024-09-11T00:44:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.624+0000 7fb12da00640 1 -- 172.21.15.81:0/3392866258 wait complete. 2024-09-11T00:44:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.626+0000 7fb12da00640 1 Processor -- start 2024-09-11T00:44:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.626+0000 7fb12da00640 1 -- start start 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128074860 0x7fb128154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb128152610 0x7fb1280cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb128070cf0 con 0x7fb1281559f0 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb12815c140 con 0x7fb128074860 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb12da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb1281529f0 con 0x7fb128152610 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb127400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb127400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60718/0 (socket says 172.21.15.81:60718) 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb127400640 1 -- 172.21.15.81:0/1613854318 learned_addr learned my addr 172.21.15.81:0/1613854318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb126000640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb128152610 0x7fb1280cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.627+0000 7fb126a00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128074860 0x7fb128154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 -- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb128152610 msgr2=0x7fb1280cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb128152610 0x7fb1280cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 -- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128074860 msgr2=0x7fb128154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128074860 0x7fb128154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 -- 172.21.15.81:0/1613854318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1281f3ef0 con 0x7fb1281559f0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb127400640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c3c0 tx=0x7fb12000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120011790 con 0x7fb1281559f0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb120017070 con 0x7fb1281559f0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb128152fd0 con 0x7fb1281559f0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120011ce0 con 0x7fb1281559f0 2024-09-11T00:44:50.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.628+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281f4490 con 0x7fb1281559f0 2024-09-11T00:44:50.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.630+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1280c2ea0 con 0x7fb1281559f0 2024-09-11T00:44:50.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.630+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb12001c460 con 0x7fb1281559f0 2024-09-11T00:44:50.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.631+0000 7fb11ea00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 0x7fb10807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:50.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.631+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb120099cb0 con 0x7fb1281559f0 2024-09-11T00:44:50.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.632+0000 7fb126a00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 0x7fb10807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:50.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.632+0000 7fb126a00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 0x7fb10807a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb118005fd0 tx=0x7fb1180095e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:50.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.635+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb120061e20 con 0x7fb1281559f0 2024-09-11T00:44:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.856+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1280c11b0 con 0x7fb1281559f0 2024-09-11T00:44:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.857+0000 7fb11ea00640 1 -- 172.21.15.81:0/1613854318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb120066850 con 0x7fb1281559f0 2024-09-11T00:44:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:50.859 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:44:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 msgr2=0x7fb10807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 0x7fb10807a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb118005fd0 tx=0x7fb1180095e0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 msgr2=0x7fb128153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c3c0 tx=0x7fb12000c880 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 shutdown_connections 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb108077f70 0x7fb10807a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1281559f0 0x7fb128153800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb128152610 0x7fb1280cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 --2- 172.21.15.81:0/1613854318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128074860 0x7fb128154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 >> 172.21.15.81:0/1613854318 conn(0x7fb1280700f0 msgr2=0x7fb12806f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 shutdown_connections 2024-09-11T00:44:50.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:50.859+0000 7fb12da00640 1 -- 172.21.15.81:0/1613854318 wait complete. 2024-09-11T00:44:50.878 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:44:50.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:51.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 -- 172.21.15.81:0/3312098165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61240c8680 msgr2=0x7f61240c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 --2- 172.21.15.81:0/3312098165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61240c8680 0x7f61240c7ec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61240762c0 tx=0x7f611c02aac0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 -- 172.21.15.81:0/3312098165 shutdown_connections 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 --2- 172.21.15.81:0/3312098165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61240c8680 0x7f61240c7ec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 --2- 172.21.15.81:0/3312098165 >> v2:172.21.15.167:3300/0 conn(0x7f6124074860 0x7f61240c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 --2- 172.21.15.81:0/3312098165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6124152610 0x7f61240c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 -- 172.21.15.81:0/3312098165 >> 172.21.15.81:0/3312098165 conn(0x7f61240700f0 msgr2=0x7f6124070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 -- 172.21.15.81:0/3312098165 shutdown_connections 2024-09-11T00:44:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.032+0000 7f612b800640 1 -- 172.21.15.81:0/3312098165 wait complete. 2024-09-11T00:44:51.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.034+0000 7f612b800640 1 Processor -- start 2024-09-11T00:44:51.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.034+0000 7f612b800640 1 -- start start 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6124152610 0x7f6124146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124155190 0x7f61240c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6124070cf0 con 0x7f6124074860 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f612415c140 con 0x7f6124155190 2024-09-11T00:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f612b800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f61241529f0 con 0x7f6124152610 2024-09-11T00:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60742/0 (socket says 172.21.15.81:60742) 2024-09-11T00:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 -- 172.21.15.81:0/2327833697 learned_addr learned my addr 172.21.15.81:0/2327833697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 -- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6124152610 msgr2=0x7f6124146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6124152610 0x7f6124146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 -- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124155190 msgr2=0x7f61240c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124155190 0x7f61240c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.035+0000 7f6128e00640 1 -- 172.21.15.81:0/2327833697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6124072cf0 con 0x7f6124074860 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f6128e00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f611400d770 tx=0x7f611400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114017070 con 0x7f6124074860 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6114009d20 con 0x7f6124074860 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140106c0 con 0x7f6124074860 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6124074540 con 0x7f6124074860 2024-09-11T00:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.036+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6124073270 con 0x7f6124074860 2024-09-11T00:44:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.037+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61240b22f0 con 0x7f6124074860 2024-09-11T00:44:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.038+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6114010860 con 0x7f6124074860 2024-09-11T00:44:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.039+0000 7f6120c00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 0x7f610407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.039+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f611409a480 con 0x7f6124074860 2024-09-11T00:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.040+0000 7f6123e00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 0x7f610407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.040+0000 7f6123e00640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 0x7f610407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6110005d80 tx=0x7f6110005cb0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.043+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f61240b22f0 con 0x7f6124074860 2024-09-11T00:44:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.262+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61240c2ea0 con 0x7f6124074860 2024-09-11T00:44:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.263+0000 7f6120c00640 1 -- 172.21.15.81:0/2327833697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f6114062cd0 con 0x7f6124074860 2024-09-11T00:44:51.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:51.266 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 msgr2=0x7f610407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 0x7f610407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6110005d80 tx=0x7f6110005cb0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 msgr2=0x7f61241f0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f611400d770 tx=0x7f611400dc30 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 shutdown_connections 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6104077f70 0x7f610407a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124155190 0x7f61240c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6124152610 0x7f6124146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 --2- 172.21.15.81:0/2327833697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6124074860 0x7f61241f0e70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 >> 172.21.15.81:0/2327833697 conn(0x7f61240700f0 msgr2=0x7f612406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 shutdown_connections 2024-09-11T00:44:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.266+0000 7f612b800640 1 -- 172.21.15.81:0/2327833697 wait complete. 2024-09-11T00:44:51.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 -- 172.21.15.81:0/3055882386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba4151290 msgr2=0x7f4ba40cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 --2- 172.21.15.81:0/3055882386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba4151290 0x7f4ba40cd240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40b6590 tx=0x7f4b9802a560 comp rx=0 tx=0).stop 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 -- 172.21.15.81:0/3055882386 shutdown_connections 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 --2- 172.21.15.81:0/3055882386 >> v2:172.21.15.167:3300/0 conn(0x7f4ba4068ff0 0x7f4ba40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 --2- 172.21.15.81:0/3055882386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba4151290 0x7f4ba40cd240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 -- 172.21.15.81:0/3055882386 >> 172.21.15.81:0/3055882386 conn(0x7f4ba406d570 msgr2=0x7f4ba40688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 -- 172.21.15.81:0/3055882386 shutdown_connections 2024-09-11T00:44:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.439+0000 7f4bac600640 1 -- 172.21.15.81:0/3055882386 wait complete. 2024-09-11T00:44:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.440+0000 7f4bac600640 1 Processor -- start 2024-09-11T00:44:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.440+0000 7f4bac600640 1 -- start start 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba4068ff0 0x7f4ba4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba4151290 0x7f4ba4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40cb470 con 0x7f4ba415a6e0 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4154d80 con 0x7f4ba4068ff0 2024-09-11T00:44:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.441+0000 7f4bac600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba415b220 con 0x7f4ba4151290 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4ba9c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba4068ff0 0x7f4ba4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4ba9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba4151290 0x7f4ba4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60760/0 (socket says 172.21.15.81:60760) 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 -- 172.21.15.81:0/756872567 learned_addr learned my addr 172.21.15.81:0/756872567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 -- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba4151290 msgr2=0x7f4ba4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba4151290 0x7f4ba4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 -- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba4068ff0 msgr2=0x7f4ba4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba4068ff0 0x7f4ba4152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 -- 172.21.15.81:0/756872567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba4153900 con 0x7f4ba415a6e0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.442+0000 7f4baa600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00b9a0 tx=0x7f4b9c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.443+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c019070 con 0x7f4ba415a6e0 2024-09-11T00:44:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.443+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b9c00cc90 con 0x7f4ba415a6e0 2024-09-11T00:44:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.443+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba4153ba0 con 0x7f4ba415a6e0 2024-09-11T00:44:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.443+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0146a0 con 0x7f4ba415a6e0 2024-09-11T00:44:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.443+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba4154120 con 0x7f4ba415a6e0 2024-09-11T00:44:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.444+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba40c5030 con 0x7f4ba415a6e0 2024-09-11T00:44:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.445+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4b9c01e440 con 0x7f4ba415a6e0 2024-09-11T00:44:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.446+0000 7f4ba1600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.446+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4b9c09a0a0 con 0x7f4ba415a6e0 2024-09-11T00:44:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.446+0000 7f4ba9c00640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.447+0000 7f4ba9c00640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 0x7f4b8407a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b98033000 tx=0x7f4b98004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.450+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4b9c0620e0 con 0x7f4ba415a6e0 2024-09-11T00:44:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.667+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba4158000 con 0x7f4ba415a6e0 2024-09-11T00:44:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.668+0000 7f4ba1600640 1 -- 172.21.15.81:0/756872567 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f4b9c066b10 con 0x7f4ba415a6e0 2024-09-11T00:44:51.670 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:51.670 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:51.670 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 msgr2=0x7f4b8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 0x7f4b8407a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b98033000 tx=0x7f4b98004730 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 msgr2=0x7f4ba4149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00b9a0 tx=0x7f4b9c00be60 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 shutdown_connections 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba415a6e0 0x7f4ba4149040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba4151290 0x7f4ba4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 --2- 172.21.15.81:0/756872567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba4068ff0 0x7f4ba4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 >> 172.21.15.81:0/756872567 conn(0x7f4ba406d570 msgr2=0x7f4ba4150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 shutdown_connections 2024-09-11T00:44:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.670+0000 7f4bac600640 1 -- 172.21.15.81:0/756872567 wait complete. 2024-09-11T00:44:51.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 -- 172.21.15.81:0/984062573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d480b1f10 msgr2=0x7f3d480745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/984062573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d480b1f10 0x7f3d480745f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009830 tx=0x7f3d3402a5c0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 -- 172.21.15.81:0/984062573 shutdown_connections 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/984062573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d480b1f10 0x7f3d480745f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 -- 172.21.15.81:0/984062573 >> 172.21.15.81:0/984062573 conn(0x7f3d4806ffd0 msgr2=0x7f3d480703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 -- 172.21.15.81:0/984062573 shutdown_connections 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.844+0000 7f3d4ca00640 1 -- 172.21.15.81:0/984062573 wait complete. 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.845+0000 7f3d4ca00640 1 Processor -- start 2024-09-11T00:44:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.845+0000 7f3d4ca00640 1 -- start start 2024-09-11T00:44:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48074b30 0x7f3d480ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4814ebc0 0x7f3d481f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d480c7040 con 0x7f3d480b1f10 2024-09-11T00:44:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d481581a0 con 0x7f3d48074b30 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d4ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4814efa0 con 0x7f3d4814ebc0 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d46a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d46a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60764/0 (socket says 172.21.15.81:60764) 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.846+0000 7f3d46a00640 1 -- 172.21.15.81:0/2095267982 learned_addr learned my addr 172.21.15.81:0/2095267982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d47400640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48074b30 0x7f3d480ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d47e00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4814ebc0 0x7f3d481f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 -- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4814ebc0 msgr2=0x7f3d481f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4814ebc0 0x7f3d481f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 -- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48074b30 msgr2=0x7f3d480ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48074b30 0x7f3d480ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 -- 172.21.15.81:0/2095267982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d480cc970 con 0x7f3d480b1f10 2024-09-11T00:44:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d46a00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009950 tx=0x7f3d34032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.847+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34040070 con 0x7f3d480b1f10 2024-09-11T00:44:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.848+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d34005310 con 0x7f3d480b1f10 2024-09-11T00:44:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.848+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d48157250 con 0x7f3d480b1f10 2024-09-11T00:44:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.848+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d340047a0 con 0x7f3d480b1f10 2024-09-11T00:44:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.848+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d481f23f0 con 0x7f3d480b1f10 2024-09-11T00:44:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.849+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d481f46f0 con 0x7f3d480b1f10 2024-09-11T00:44:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.850+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3d34004940 con 0x7f3d480b1f10 2024-09-11T00:44:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.851+0000 7f3d3f400640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 0x7f3d2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.851+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d340bb150 con 0x7f3d480b1f10 2024-09-11T00:44:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.851+0000 7f3d47400640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 0x7f3d2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.852+0000 7f3d47400640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 0x7f3d2807a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d38000f60 tx=0x7f3d38009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:51.854+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3d3404b030 con 0x7f3d480b1f10 2024-09-11T00:44:52.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.037+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d480745f0 con 0x7f3d480b1f10 2024-09-11T00:44:52.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.038+0000 7f3d3f400640 1 -- 172.21.15.81:0/2095267982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f3d34083110 con 0x7f3d480b1f10 2024-09-11T00:44:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:52.041 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:21.786041+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 msgr2=0x7f3d2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 0x7f3d2807a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d38000f60 tx=0x7f3d38009040 comp rx=0 tx=0).stop 2024-09-11T00:44:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 msgr2=0x7f3d481f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009950 tx=0x7f3d34032b90 comp rx=0 tx=0).stop 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 shutdown_connections 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3d28077f70 0x7f3d2807a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4814ebc0 0x7f3d481f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d480b1f10 0x7f3d481f3cb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 --2- 172.21.15.81:0/2095267982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48074b30 0x7f3d480ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 >> 172.21.15.81:0/2095267982 conn(0x7f3d4806ffd0 msgr2=0x7f3d4814b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 shutdown_connections 2024-09-11T00:44:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.041+0000 7f3d4ca00640 1 -- 172.21.15.81:0/2095267982 wait complete. 2024-09-11T00:44:52.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 -- 172.21.15.81:0/1188808361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 msgr2=0x7fc0b815aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 --2- 172.21.15.81:0/1188808361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b815aeb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009ca0 tx=0x7fc0b002abf0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 -- 172.21.15.81:0/1188808361 shutdown_connections 2024-09-11T00:44:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 --2- 172.21.15.81:0/1188808361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b815aeb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 -- 172.21.15.81:0/1188808361 >> 172.21.15.81:0/1188808361 conn(0x7fc0b806ffd0 msgr2=0x7fc0b80703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 -- 172.21.15.81:0/1188808361 shutdown_connections 2024-09-11T00:44:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.213+0000 7fc0bda00640 1 -- 172.21.15.81:0/1188808361 wait complete. 2024-09-11T00:44:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.215+0000 7fc0bda00640 1 Processor -- start 2024-09-11T00:44:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.215+0000 7fc0bda00640 1 -- start start 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b80c6bc0 0x7fc0b80aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0b80c6fa0 0x7fc0b8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b815d9e0 con 0x7fc0b80c8a40 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b80c7e10 con 0x7fc0b80c6bc0 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bda00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b8154a00 con 0x7fc0b80c6fa0 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60780/0 (socket says 172.21.15.81:60780) 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 -- 172.21.15.81:0/2331095986 learned_addr learned my addr 172.21.15.81:0/2331095986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0b7400640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0b80c6fa0 0x7fc0b8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0b7e00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b80c6bc0 0x7fc0b80aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 -- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0b80c6fa0 msgr2=0x7fc0b8150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0b80c6fa0 0x7fc0b8150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 -- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b80c6bc0 msgr2=0x7fc0b80aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b80c6bc0 0x7fc0b80aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.216+0000 7fc0bd000640 1 -- 172.21.15.81:0/2331095986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b81599b0 con 0x7fc0b80c8a40 2024-09-11T00:44:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0bd000640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0036040 tx=0x7fc0b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0004670 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0b0045070 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b81f3910 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b003e650 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.217+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b81f3ed0 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.218+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b80c0eb0 con 0x7fc0b80c8a40 2024-09-11T00:44:52.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.219+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc0b003e7f0 con 0x7fc0b80c8a40 2024-09-11T00:44:52.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.220+0000 7fc0afe00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 0x7fc09807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.220+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc0b00bb920 con 0x7fc0b80c8a40 2024-09-11T00:44:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.221+0000 7fc0b7e00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 0x7fc09807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.221+0000 7fc0b7e00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 0x7fc09807a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80017c0 tx=0x7fc0a8009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:52.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.224+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc0b0083a00 con 0x7fc0b80c8a40 2024-09-11T00:44:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.446+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0b8075160 con 0x7fc0b80c8a40 2024-09-11T00:44:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.447+0000 7fc0afe00640 1 -- 172.21.15.81:0/2331095986 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fc0b0088430 con 0x7fc0b80c8a40 2024-09-11T00:44:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:52.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:52.450 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 msgr2=0x7fc09807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 0x7fc09807a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80017c0 tx=0x7fc0a8009040 comp rx=0 tx=0).stop 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 msgr2=0x7fc0b8150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0036040 tx=0x7fc0b0004270 comp rx=0 tx=0).stop 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 shutdown_connections 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc098077f70 0x7fc09807a430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b80c8a40 0x7fc0b8150a80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0b80c6fa0 0x7fc0b8150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 --2- 172.21.15.81:0/2331095986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b80c6bc0 0x7fc0b80aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.449+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 >> 172.21.15.81:0/2331095986 conn(0x7fc0b806ffd0 msgr2=0x7fc0b80703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.450+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 shutdown_connections 2024-09-11T00:44:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:52.450+0000 7fc0bda00640 1 -- 172.21.15.81:0/2331095986 wait complete. 2024-09-11T00:44:53.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:44:16.758683+0000', 'modified': '2024-09-11T00:44:42.883390+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4411': {'gid': 4411, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6835/1821136348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 1821136348}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 1821136348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4411, 'qdb_cluster': [4411]} 2024-09-11T00:44:53.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:44:53.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T00:44:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 -- 172.21.15.81:0/1699883440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 msgr2=0x7f7140004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 --2- 172.21.15.81:0/1699883440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7140004c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d00 tx=0x7f7140005830 comp rx=0 tx=0).stop 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 -- 172.21.15.81:0/1699883440 shutdown_connections 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 --2- 172.21.15.81:0/1699883440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7140004c80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 -- 172.21.15.81:0/1699883440 >> 172.21.15.81:0/1699883440 conn(0x7f715806c9e0 msgr2=0x7f715806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 -- 172.21.15.81:0/1699883440 shutdown_connections 2024-09-11T00:44:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.232+0000 7f7160400640 1 -- 172.21.15.81:0/1699883440 wait complete. 2024-09-11T00:44:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.234+0000 7f7160400640 1 Processor -- start 2024-09-11T00:44:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.234+0000 7f7160400640 1 -- start start 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71580cb500 0x7f71581450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71580cb940 0x7f71581455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7158157940 con 0x7f7140004800 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7158157660 con 0x7f71580cb500 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f7160400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7158157c20 con 0x7f71580cb940 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60792/0 (socket says 172.21.15.81:60792) 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 -- 172.21.15.81:0/1710958039 learned_addr learned my addr 172.21.15.81:0/1710958039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715e400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71580cb940 0x7f71581455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715d000640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71580cb500 0x7f71581450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 -- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71580cb940 msgr2=0x7f71581455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71580cb940 0x7f71581455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 -- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71580cb500 msgr2=0x7f71581450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71580cb500 0x7f71581450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.235+0000 7f715da00640 1 -- 172.21.15.81:0/1710958039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715814bdf0 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f715da00640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f714c003cd0 tx=0x7f714c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f7155600640 1 -- 172.21.15.81:0/1710958039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c011640 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f7155600640 1 -- 172.21.15.81:0/1710958039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c016020 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f7155600640 1 -- 172.21.15.81:0/1710958039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c011ac0 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715814bb10 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.236+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71580c8fb0 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.238+0000 7f7155600640 1 -- 172.21.15.81:0/1710958039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f714c011c60 con 0x7f7140004800 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.239+0000 7f7155600640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 0x7f713807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.239+0000 7f7155600640 1 -- 172.21.15.81:0/1710958039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f714c09a970 con 0x7f7140004800 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.239+0000 7f715d000640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 0x7f713807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.239+0000 7f71633fd740 1 Processor -- start 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 -- start start 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f715d000640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 0x7f713807a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7144035000 tx=0x7f71440046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a900faba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a90130890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a9007e430 con 0x555a900f8d70 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a9006e5d0 con 0x555a900f9150 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.240+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555a9005da00 con 0x555a90130410 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60794/0 (socket says 172.21.15.81:60794) 2024-09-11T00:44:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 -- 172.21.15.81:0/2804070808 learned_addr learned my addr 172.21.15.81:0/2804070808 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715e400640 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a90130890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715d000640 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a900faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 -- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 msgr2=0x555a90130890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a90130890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 -- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 msgr2=0x555a900faba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a900faba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 -- 172.21.15.81:0/2804070808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a90026520 con 0x555a900f8d70 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.241+0000 7f715da00640 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f714c062720 tx=0x7f714c05e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2251858fa59183 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f714a000640 1 -- 172.21.15.81:0/2804070808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c015040 con 0x555a900f8d70 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f714a000640 1 -- 172.21.15.81:0/2804070808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c062a20 con 0x555a900f8d70 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f714a000640 1 -- 172.21.15.81:0/2804070808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c067500 con 0x555a900f8d70 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 -- 172.21.15.81:0/2804070808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 msgr2=0x555a900fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f714c062720 tx=0x7f714c05e9d0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 -- 172.21.15.81:0/2804070808 shutdown_connections 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a90130890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a900faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 --2- 172.21.15.81:0/2804070808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f8d70 0x555a900fa660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 -- 172.21.15.81:0/2804070808 >> 172.21.15.81:0/2804070808 conn(0x555a900f6f50 msgr2=0x555a900f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 -- 172.21.15.81:0/2804070808 shutdown_connections 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.242+0000 7f71633fd740 1 -- 172.21.15.81:0/2804070808 wait complete. 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.243+0000 7f71633fd740 1 -- start start 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.243+0000 7f71633fd740 1 Processor -- start 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a9012e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a9012ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a90004330 con 0x555a9012dca0 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a90061810 con 0x555a900f9150 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555a8fdce620 con 0x555a90130410 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.244+0000 7f71633fd740 10 client.0 _ll_register_callbacks cb 0x555a90009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a9012e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a9012ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a9012e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:53768/0 (socket says 172.21.15.81:53768) 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60802/0 (socket says 172.21.15.81:60802) 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715da00640 1 -- 172.21.15.81:0/1724204370 learned_addr learned my addr 172.21.15.81:0/1724204370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a9012ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60316/0 (socket says 172.21.15.81:60316) 2024-09-11T00:44:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 -- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 msgr2=0x555a9012ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a9012ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 -- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 msgr2=0x555a9012e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a9012e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 -- 172.21.15.81:0/1724204370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a8fdbf850 con 0x555a9012dca0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f715e400640 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71580c9ed0 tx=0x7f7150017cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e72a7d07930b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f713ea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.245+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150003970 con 0x555a9012dca0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7150003b10 con 0x555a9012dca0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f714c062a20 con 0x555a9012dca0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7150026050 con 0x555a9012dca0 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 10 client.4773 fetch_fsmap learned FSMap version 9 2024-09-11T00:44:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555a8fe366b0 con 0x555a9012dca0 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c062a20 con 0x555a9012dca0 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7150029020 con 0x555a9012dca0 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 10 client.4773 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 10 client.4773 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 20 client.4773 populate_metadata read hostname 'smithi081' 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a9014f040 0x555a9015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 4 client.4773 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.246+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a90070520 con 0x555a9014f040 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.247+0000 7f715da00640 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a9014f040 0x555a9015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.247+0000 7f715da00640 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a9014f040 0x555a9015a0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=624fd1da4376e41a server_cookie=3f47d62d0d5df5dd in_seq=0 out_seq=0 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.247+0000 7f713ea00640 10 client.4773 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f713ea00640 1 -- 172.21.15.81:0/1724204370 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a90070520 con 0x555a9014f040 2024-09-11T00:44:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f713ea00640 10 client.4773 handle_command_reply: tid=0 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 client.4773 shutdown 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 msgr2=0x555a9014e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71580c9ed0 tx=0x7f7150017cf0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 shutdown_connections 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a9014f040 0x555a9015a0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a9012dca0 0x555a9014e630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a90130410 0x555a9012ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 --2- 172.21.15.81:0/1724204370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a900f9150 0x555a9012e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f713ea00640 0 client.4773 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 >> 172.21.15.81:0/1724204370 conn(0x555a900f8d70 msgr2=0x555a900f5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 shutdown_connections 2024-09-11T00:44:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.248+0000 7f71633fd740 1 -- 172.21.15.81:0/1724204370 wait complete. 2024-09-11T00:44:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.249+0000 7f71633fd740 20 client.4773 trim_cache size 0 max 16384 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.267+0000 7f71633fd740 1 Processor -- start 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.267+0000 7f71633fd740 1 -- start start 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a9012dca0 0x555a900fa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 0x555a900fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71581f97b0 con 0x555a900f9150 2024-09-11T00:44:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a9012a6a0 con 0x555a90130410 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555a9012b780 con 0x555a9012dca0 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f715da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60804/0 (socket says 172.21.15.81:60804) 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.268+0000 7f715da00640 1 -- 172.21.15.81:0/2887289742 learned_addr learned my addr 172.21.15.81:0/2887289742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715d000640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a9012dca0 0x555a900fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715e400640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 0x555a900fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 -- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a9012dca0 msgr2=0x555a900fa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a9012dca0 0x555a900fa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 -- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 msgr2=0x555a900fada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 0x555a900fada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 -- 172.21.15.81:0/2887289742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a900f6ca0 con 0x555a900f9150 2024-09-11T00:44:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715e400640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 0x555a900fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f715da00640 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f714c062720 tx=0x7f714c07b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c372ec6e51fbae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f7149600640 1 -- 172.21.15.81:0/2887289742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c015040 con 0x555a900f9150 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f7149600640 1 -- 172.21.15.81:0/2887289742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c067150 con 0x555a900f9150 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.269+0000 7f7149600640 1 -- 172.21.15.81:0/2887289742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c067300 con 0x555a900f9150 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- 172.21.15.81:0/2887289742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 msgr2=0x555a900fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f714c062720 tx=0x7f714c07b040 comp rx=0 tx=0).stop 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- 172.21.15.81:0/2887289742 shutdown_connections 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a90130410 0x555a900fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a9012dca0 0x555a900fa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 --2- 172.21.15.81:0/2887289742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a900f9150 0x555a900fbce0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- 172.21.15.81:0/2887289742 >> 172.21.15.81:0/2887289742 conn(0x555a900f8d70 msgr2=0x555a900f5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- 172.21.15.81:0/2887289742 shutdown_connections 2024-09-11T00:44:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- 172.21.15.81:0/2887289742 wait complete. 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.270+0000 7f71633fd740 1 -- start start 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.271+0000 7f71633fd740 1 Processor -- start 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.271+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a900f9150 0x555a90134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a9012dca0 0x555a901bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a9014f4c0 con 0x555a90130410 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a9014cb20 con 0x555a9012dca0 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555a90122e00 con 0x555a900f9150 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f71633fd740 10 client.0 _ll_register_callbacks cb 0x7f7150002170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60816/0 (socket says 172.21.15.81:60816) 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 -- 172.21.15.81:0/3237349633 learned_addr learned my addr 172.21.15.81:0/3237349633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715da00640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a900f9150 0x555a90134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715d000640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a9012dca0 0x555a901bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 -- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a900f9150 msgr2=0x555a90134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a900f9150 0x555a90134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 -- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a9012dca0 msgr2=0x555a901bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a9012dca0 0x555a901bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.272+0000 7f715e400640 1 -- 172.21.15.81:0/3237349633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9012e2b0 con 0x555a90130410 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f715e400640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71580c9ed0 tx=0x7f7150005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8594a405b0540b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71500052e0 con 0x555a90130410 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7150001d50 con 0x555a90130410 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f714c067150 con 0x555a90130410 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7150036050 con 0x555a90130410 2024-09-11T00:44:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 10 client.4779 fetch_fsmap learned FSMap version 9 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555a90160110 con 0x555a90130410 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f714c067150 con 0x555a90130410 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7150039020 con 0x555a90130410 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 10 client.4779 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 10 client.4779 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 20 client.4779 populate_metadata read hostname 'smithi081' 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a901bc750 0x555a901c8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 4 client.4779 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.273+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "status"}) -- 0x555a9006bfd0 con 0x555a901bc750 2024-09-11T00:44:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.274+0000 7f715da00640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a901bc750 0x555a901c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.274+0000 7f715da00640 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a901bc750 0x555a901c8650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8ef010462cf6f0 server_cookie=62d9fa329e0bd7bd in_seq=0 out_seq=0 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.274+0000 7f713ea00640 10 client.4779 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f713ea00640 1 -- 172.21.15.81:0/3237349633 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x555a9006bfd0 con 0x555a901bc750 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f713ea00640 10 client.4779 handle_command_reply: tid=0 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 client.4779 shutdown 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 msgr2=0x555a901b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71580c9ed0 tx=0x7f7150005d40 comp rx=0 tx=0).stop 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 shutdown_connections 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555a901bc750 0x555a901c8650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a90130410 0x555a901b8e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a9012dca0 0x555a901bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f713ea00640 0 client.4779 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 --2- 172.21.15.81:0/3237349633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555a900f9150 0x555a90134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 >> 172.21.15.81:0/3237349633 conn(0x555a900f8d70 msgr2=0x555a900f5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 shutdown_connections 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 1 -- 172.21.15.81:0/3237349633 wait complete. 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.275+0000 7f71633fd740 20 client.4779 trim_cache size 0 max 16384 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "62a8ae86-7f85-478f-9a99-4c394aac48f1", 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4411, 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-11T00:44:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 35.950732592999998, 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 27, 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 27, 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 41.97144033 2024-09-11T00:44:53.285 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 msgr2=0x7f713807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 0x7f713807a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7144035000 tx=0x7f71440046c0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 msgr2=0x7f7158156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f714c003cd0 tx=0x7f714c001800 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 shutdown_connections 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7138077f70 0x7f713807a430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71580cb940 0x7f71581455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71580cb500 0x7f71581450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 --2- 172.21.15.81:0/1710958039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7140004800 0x7f7158156cc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 >> 172.21.15.81:0/1710958039 conn(0x7f715806c9e0 msgr2=0x7f7158153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 shutdown_connections 2024-09-11T00:44:53.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.276+0000 7f7160400640 1 -- 172.21.15.81:0/1710958039 wait complete. 2024-09-11T00:44:53.294 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T00:44:53.305 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T00:44:53.305 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-11T00:44:53.305 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T00:44:53.305 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:44:53.305 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:53.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:53.306 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-11T00:44:53.341 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T00:44:53.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:53.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T00:44:53.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:53.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-11T00:44:53.723 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T00:44:53.723 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:44:53.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:44:53.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 -- 172.21.15.81:0/537764567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26581513b0 msgr2=0x7f2658151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 --2- 172.21.15.81:0/537764567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26581513b0 0x7f2658151790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2648005fd0 tx=0x7f264802a670 comp rx=0 tx=0).stop 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 -- 172.21.15.81:0/537764567 shutdown_connections 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 --2- 172.21.15.81:0/537764567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26581513b0 0x7f2658151790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 -- 172.21.15.81:0/537764567 >> 172.21.15.81:0/537764567 conn(0x7f26580700f0 msgr2=0x7f2658070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 -- 172.21.15.81:0/537764567 shutdown_connections 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.878+0000 7f265e600640 1 -- 172.21.15.81:0/537764567 wait complete. 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.879+0000 7f265e600640 1 Processor -- start 2024-09-11T00:44:53.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.879+0000 7f265e600640 1 -- start start 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26581513b0 0x7f26580c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2658157b30 0x7f265814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26581576a0 con 0x7f2658157f80 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f265806ebd0 con 0x7f2658157b30 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.880+0000 7f265e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f265806f5e0 con 0x7f26581513b0 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40000/0 (socket says 172.21.15.81:40000) 2024-09-11T00:44:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 -- 172.21.15.81:0/290084085 learned_addr learned my addr 172.21.15.81:0/290084085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2656a00640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2658157b30 0x7f265814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657400640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26581513b0 0x7f26580c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 -- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26581513b0 msgr2=0x7f26580c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26581513b0 0x7f26580c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 -- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2658157b30 msgr2=0x7f265814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2658157b30 0x7f265814e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 -- 172.21.15.81:0/290084085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265814bd40 con 0x7f2658157f80 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.881+0000 7f2657e00640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f265000c7b0 tx=0x7f265000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.882+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650017070 con 0x7f2658157f80 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.882+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2650005070 con 0x7f2658157f80 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.882+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265814ef30 con 0x7f2658157f80 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.882+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500054c0 con 0x7f2658157f80 2024-09-11T00:44:53.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.882+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f265814d960 con 0x7f2658157f80 2024-09-11T00:44:53.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.883+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2658070c10 con 0x7f2658157f80 2024-09-11T00:44:53.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.884+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2650005660 con 0x7f2658157f80 2024-09-11T00:44:53.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.885+0000 7f264f400640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 0x7f263807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:53.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.885+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2650099a40 con 0x7f2658157f80 2024-09-11T00:44:53.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.885+0000 7f2657400640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 0x7f263807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:53.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.886+0000 7f2657400640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 0x7f263807a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2648033000 tx=0x7f2648004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:53.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:53.889+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2650061b10 con 0x7f2658157f80 2024-09-11T00:44:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.106+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2658157320 con 0x7f2658157f80 2024-09-11T00:44:54.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.106+0000 7f264f400640 1 -- 172.21.15.81:0/290084085 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f2650066540 con 0x7f2658157f80 2024-09-11T00:44:54.109 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T00:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 msgr2=0x7f263807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 0x7f263807a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2648033000 tx=0x7f2648004730 comp rx=0 tx=0).stop 2024-09-11T00:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 msgr2=0x7f26581ee790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f265000c7b0 tx=0x7f265000cc70 comp rx=0 tx=0).stop 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 shutdown_connections 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2638077fa0 0x7f263807a460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2658157f80 0x7f26581ee790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2658157b30 0x7f265814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 --2- 172.21.15.81:0/290084085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26581513b0 0x7f26580c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 >> 172.21.15.81:0/290084085 conn(0x7f26580700f0 msgr2=0x7f265814f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 shutdown_connections 2024-09-11T00:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54.109+0000 7f265e600640 1 -- 172.21.15.81:0/290084085 wait complete. 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:44:54.127 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:44:54.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:54.128 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-11T00:44:54.163 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:44:54.163 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:44:54.163 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:44:54.163 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:44:54.164 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42638sec preferred_lft 42638sec 2024-09-11T00:44:54.165 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-11T00:44:54.165 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:44:54.165 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:44:54.165 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:54.165 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:54.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:44:54.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-11T00:44:54.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-11T00:44:54.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:44:54.166 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:54.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:54.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:54.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:54.385 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:44:54.438 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-11T00:44:54.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:54.442 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-11T00:44:54.478 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-11T00:44:54.478 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:44:54.478 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:44:54.478 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:44:54.479 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:44:54.479 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:54.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:54.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:54.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:54.676 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-11T00:44:54.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:54.712 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-11T00:44:54.787 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:54.787 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:54.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:44:54.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:44:54.787 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:54.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:54.963 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:44:54.963 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:54.963 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:54.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:44:54.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:44:54.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:44:54.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:44:54.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:44:54.964 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:55.182 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:44:55.182 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-11T00:44:55.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-11T00:44:55.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:44:55.183 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-11T00:44:55.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:44:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:55.347 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T00:44:55.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:44:55.347 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:55.383 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:44:55.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:44:55.383 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:55.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-11T00:44:55.555 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-11T00:44:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:44:55.592 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:44:55.593 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:44:55.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:55.594 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-11T00:44:55.670 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:44:55.671 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T00:44:55.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-11T00:44:55.771 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:44:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-11T00:44:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-11T00:44:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-11T00:44:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:44:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:44:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:44:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-11T00:44:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:44:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:44:55.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:55.811 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-11T00:44:55.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-11T00:44:55.857+0000 7f6eb3aef480 -1 init, newargv = 0x5620e6428de0 newargc=15 2024-09-11T00:44:55.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45017]: starting ceph client 2024-09-11T00:44:55.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45017]: starting fuse 2024-09-11T00:44:55.891 INFO:teuthology.orchestra.run.smithi081.stdout:43 2024-09-11T00:44:55.891 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-11T00:44:55.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:44:55.891 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-11T00:44:55.891 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:55.892 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-11T00:44:55.893 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-11T00:44:56.053 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.45017.asok 2024-09-11T00:44:56.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:44:56.067 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45017.asok 2024-09-11T00:44:56.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:56.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45017.asok status 2024-09-11T00:44:56.250 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:44:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-11T00:44:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45017", 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4794, 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-11T00:44:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4794 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3529336264 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3529336264 2024-09-11T00:44:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4794 192.168.0.1:0/3529336264", 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3529336264", 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 9, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 27, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-11T00:44:56.253 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:44:56.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:56.262 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-11T00:44:56.262 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:56.298 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-11T00:44:56.298 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:56.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:44:56.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:56.395 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-11T00:44:56.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:44:56.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:56.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 -- 172.21.15.81:0/76089742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728074860 msgr2=0x7fb7280c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 --2- 172.21.15.81:0/76089742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728074860 0x7fb7280c7980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7280769a0 tx=0x7fb71802a680 comp rx=0 tx=0).stop 2024-09-11T00:44:56.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 -- 172.21.15.81:0/76089742 shutdown_connections 2024-09-11T00:44:56.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 --2- 172.21.15.81:0/76089742 >> v2:172.21.15.167:3300/0 conn(0x7fb7280c8680 0x7fb7280c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 --2- 172.21.15.81:0/76089742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728074860 0x7fb7280c7980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 -- 172.21.15.81:0/76089742 >> 172.21.15.81:0/76089742 conn(0x7fb7280700f0 msgr2=0x7fb728070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:56.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 -- 172.21.15.81:0/76089742 shutdown_connections 2024-09-11T00:44:56.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.570+0000 7fb730800640 1 -- 172.21.15.81:0/76089742 wait complete. 2024-09-11T00:44:56.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.571+0000 7fb730800640 1 Processor -- start 2024-09-11T00:44:56.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 -- start start 2024-09-11T00:44:56.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728074860 0x7fb7280afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb728152610 0x7fb728153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb728070cf0 con 0x7fb728155b60 2024-09-11T00:44:56.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb72815c140 con 0x7fb728074860 2024-09-11T00:44:56.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb730800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb7280c16a0 con 0x7fb728152610 2024-09-11T00:44:56.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40024/0 (socket says 172.21.15.81:40024) 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 -- 172.21.15.81:0/3382738210 learned_addr learned my addr 172.21.15.81:0/3382738210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72d400640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb728152610 0x7fb728153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72de00640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728074860 0x7fb7280afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 -- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb728152610 msgr2=0x7fb728153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb728152610 0x7fb728153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 -- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728074860 msgr2=0x7fb7280afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728074860 0x7fb7280afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 -- 172.21.15.81:0/3382738210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7281f0690 con 0x7fb728155b60 2024-09-11T00:44:56.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.573+0000 7fb72e800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb72400eb40 tx=0x7fb72400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:56.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.574+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724004b20 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.574+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb724004db0 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.574+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7280afaf0 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.574+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724005280 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.574+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7281f0c10 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.575+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7281529f0 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.576+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb724020030 con 0x7fb728155b60 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.577+0000 7fb722000640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 0x7fb70c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.577+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fb72409adf0 con 0x7fb728155b60 2024-09-11T00:44:56.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.577+0000 7fb72de00640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 0x7fb70c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.578+0000 7fb72de00640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 0x7fb70c07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb728074fb0 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:56.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.581+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb724063450 con 0x7fb728155b60 2024-09-11T00:44:56.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.761+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7280c7260 con 0x7fb70c077f70 2024-09-11T00:44:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.768+0000 7fb722000640 1 -- 172.21.15.81:0/3382738210 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332593 (secure 0 0 0) 0x7fb7280c7260 con 0x7fb70c077f70 2024-09-11T00:44:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 msgr2=0x7fb70c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 0x7fb70c07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb728074fb0 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 msgr2=0x7fb7280b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb72400eb40 tx=0x7fb72400c2d0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 shutdown_connections 2024-09-11T00:44:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb70c077f70 0x7fb70c07a430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728155b60 0x7fb7280b06e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb728152610 0x7fb728153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 --2- 172.21.15.81:0/3382738210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728074860 0x7fb7280afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 >> 172.21.15.81:0/3382738210 conn(0x7fb7280700f0 msgr2=0x7fb72814e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 shutdown_connections 2024-09-11T00:44:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.773+0000 7fb730800640 1 -- 172.21.15.81:0/3382738210 wait complete. 2024-09-11T00:44:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-11T00:44:56.503370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.684703"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:56.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:56.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 -- 172.21.15.81:0/817831381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54074860 msgr2=0x7fdb540c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 --2- 172.21.15.81:0/817831381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54074860 0x7fdb540c7980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b2270 tx=0x7fdb4002a680 comp rx=0 tx=0).stop 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 -- 172.21.15.81:0/817831381 shutdown_connections 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 --2- 172.21.15.81:0/817831381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54074860 0x7fdb540c7980 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 --2- 172.21.15.81:0/817831381 >> v2:172.21.15.167:3300/0 conn(0x7fdb54152610 0x7fdb540c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 -- 172.21.15.81:0/817831381 >> 172.21.15.81:0/817831381 conn(0x7fdb540700f0 msgr2=0x7fdb54070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 -- 172.21.15.81:0/817831381 shutdown_connections 2024-09-11T00:44:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.985+0000 7fdb5b200640 1 -- 172.21.15.81:0/817831381 wait complete. 2024-09-11T00:44:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.986+0000 7fdb5b200640 1 Processor -- start 2024-09-11T00:44:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 -- start start 2024-09-11T00:44:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb54074860 0x7fdb54155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb541e1860 0x7fdb54074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54070cf0 con 0x7fdb54152610 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5415c140 con 0x7fdb541e1860 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.987+0000 7fdb5b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdb541529f0 con 0x7fdb54074860 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40042/0 (socket says 172.21.15.81:40042) 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 -- 172.21.15.81:0/1305846249 learned_addr learned my addr 172.21.15.81:0/1305846249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53e00640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb54074860 0x7fdb54155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb59200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb541e1860 0x7fdb54074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 -- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb54074860 msgr2=0x7fdb54155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb54074860 0x7fdb54155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 -- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb541e1860 msgr2=0x7fdb54074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb541e1860 0x7fdb54074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.988+0000 7fdb53400640 1 -- 172.21.15.81:0/1305846249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb541e3830 con 0x7fdb54152610 2024-09-11T00:44:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb53400640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009850 tx=0x7fdb40003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40035030 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb40042070 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb541e3b10 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004a00 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.989+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541e40d0 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.990+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb540c2ea0 con 0x7fdb54152610 2024-09-11T00:44:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.991+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdb40004ba0 con 0x7fdb54152610 2024-09-11T00:44:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.994+0000 7fdb4be00640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 0x7fdb3407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.994+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fdb400bae20 con 0x7fdb54152610 2024-09-11T00:44:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.994+0000 7fdb53e00640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 0x7fdb3407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:56.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.994+0000 7fdb53e00640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 0x7fdb3407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009b30 tx=0x7fdb44005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:56.997+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdb40082e30 con 0x7fdb54152610 2024-09-11T00:44:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.177+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb540c2a70 con 0x7fdb34077fa0 2024-09-11T00:44:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.183+0000 7fdb4be00640 1 -- 172.21.15.81:0/1305846249 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332593 (secure 0 0 0) 0x7fdb540c2a70 con 0x7fdb34077fa0 2024-09-11T00:44:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 msgr2=0x7fdb3407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 0x7fdb3407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009b30 tx=0x7fdb44005f90 comp rx=0 tx=0).stop 2024-09-11T00:44:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 msgr2=0x7fdb54152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009850 tx=0x7fdb40003820 comp rx=0 tx=0).stop 2024-09-11T00:44:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 shutdown_connections 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdb34077fa0 0x7fdb3407a460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb541e1860 0x7fdb54074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb54152610 0x7fdb54152de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 --2- 172.21.15.81:0/1305846249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb54074860 0x7fdb54155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 >> 172.21.15.81:0/1305846249 conn(0x7fdb540700f0 msgr2=0x7fdb540c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 shutdown_connections 2024-09-11T00:44:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.188+0000 7fdb5b200640 1 -- 172.21.15.81:0/1305846249 wait complete. 2024-09-11T00:44:57.205 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-11T00:44:56.503370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2457600,"data_stored":2074536,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.684703"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414291+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:22.414291+0000","last_peered":"2024-09-11T00:44:22.414291+0000","last_clean":"2024-09-11T00:44:22.414291+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:22.414291+0000","last_undegraded":"2024-09-11T00:44:22.414291+0000","last_fullsized":"2024-09-11T00:44:22.414291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413481+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:22.413481+0000","last_peered":"2024-09-11T00:44:22.413481+0000","last_clean":"2024-09-11T00:44:22.413481+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:22.413481+0000","last_undegraded":"2024-09-11T00:44:22.413481+0000","last_fullsized":"2024-09-11T00:44:22.413481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413738+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:22.413738+0000","last_peered":"2024-09-11T00:44:22.413738+0000","last_clean":"2024-09-11T00:44:22.413738+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:22.413738+0000","last_undegraded":"2024-09-11T00:44:22.413738+0000","last_fullsized":"2024-09-11T00:44:22.413738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414057+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:22.414057+0000","last_peered":"2024-09-11T00:44:22.414057+0000","last_clean":"2024-09-11T00:44:22.414057+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:22.414057+0000","last_undegraded":"2024-09-11T00:44:22.414057+0000","last_fullsized":"2024-09-11T00:44:22.414057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414197+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:22.414197+0000","last_peered":"2024-09-11T00:44:22.414197+0000","last_clean":"2024-09-11T00:44:22.414197+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:22.414197+0000","last_undegraded":"2024-09-11T00:44:22.414197+0000","last_fullsized":"2024-09-11T00:44:22.414197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414228+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:22.414228+0000","last_peered":"2024-09-11T00:44:22.414228+0000","last_clean":"2024-09-11T00:44:22.414228+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:22.414228+0000","last_undegraded":"2024-09-11T00:44:22.414228+0000","last_fullsized":"2024-09-11T00:44:22.414228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413621+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:22.413621+0000","last_peered":"2024-09-11T00:44:22.413621+0000","last_clean":"2024-09-11T00:44:22.413621+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:22.413621+0000","last_undegraded":"2024-09-11T00:44:22.413621+0000","last_fullsized":"2024-09-11T00:44:22.413621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413890+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:22.413890+0000","last_peered":"2024-09-11T00:44:22.413890+0000","last_clean":"2024-09-11T00:44:22.413890+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:22.413890+0000","last_undegraded":"2024-09-11T00:44:22.413890+0000","last_fullsized":"2024-09-11T00:44:22.413890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414170+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:22.414170+0000","last_peered":"2024-09-11T00:44:22.414170+0000","last_clean":"2024-09-11T00:44:22.414170+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:22.414170+0000","last_undegraded":"2024-09-11T00:44:22.414170+0000","last_fullsized":"2024-09-11T00:44:22.414170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413617+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:22.413617+0000","last_peered":"2024-09-11T00:44:22.413617+0000","last_clean":"2024-09-11T00:44:22.413617+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:22.413617+0000","last_undegraded":"2024-09-11T00:44:22.413617+0000","last_fullsized":"2024-09-11T00:44:22.413617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413860+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:22.413860+0000","last_peered":"2024-09-11T00:44:22.413860+0000","last_clean":"2024-09-11T00:44:22.413860+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:22.413860+0000","last_undegraded":"2024-09-11T00:44:22.413860+0000","last_fullsized":"2024-09-11T00:44:22.413860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413733+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:22.413733+0000","last_peered":"2024-09-11T00:44:22.413733+0000","last_clean":"2024-09-11T00:44:22.413733+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:22.413733+0000","last_undegraded":"2024-09-11T00:44:22.413733+0000","last_fullsized":"2024-09-11T00:44:22.413733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413966+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:22.413966+0000","last_peered":"2024-09-11T00:44:22.413966+0000","last_clean":"2024-09-11T00:44:22.413966+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:22.413966+0000","last_undegraded":"2024-09-11T00:44:22.413966+0000","last_fullsized":"2024-09-11T00:44:22.413966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413612+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:22.413612+0000","last_peered":"2024-09-11T00:44:22.413612+0000","last_clean":"2024-09-11T00:44:22.413612+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:22.413612+0000","last_undegraded":"2024-09-11T00:44:22.413612+0000","last_fullsized":"2024-09-11T00:44:22.413612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413624+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:22.413624+0000","last_peered":"2024-09-11T00:44:22.413624+0000","last_clean":"2024-09-11T00:44:22.413624+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:22.413624+0000","last_undegraded":"2024-09-11T00:44:22.413624+0000","last_fullsized":"2024-09-11T00:44:22.413624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.413892+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:22.413892+0000","last_peered":"2024-09-11T00:44:22.413892+0000","last_clean":"2024-09-11T00:44:22.413892+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:22.413892+0000","last_undegraded":"2024-09-11T00:44:22.413892+0000","last_fullsized":"2024-09-11T00:44:22.413892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.414051+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:22.414051+0000","last_peered":"2024-09-11T00:44:22.414051+0000","last_clean":"2024-09-11T00:44:22.414051+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:22.414051+0000","last_undegraded":"2024-09-11T00:44:22.414051+0000","last_fullsized":"2024-09-11T00:44:22.414051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:57.210 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:44:57.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:44:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 -- 172.21.15.81:0/3782603722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed28152610 msgr2=0x7fed280c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3782603722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed28152610 0x7fed280c0f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009830 tx=0x7fed1c02a640 comp rx=0 tx=0).stop 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 -- 172.21.15.81:0/3782603722 shutdown_connections 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3782603722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed28152610 0x7fed280c0f90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 -- 172.21.15.81:0/3782603722 >> 172.21.15.81:0/3782603722 conn(0x7fed280700f0 msgr2=0x7fed28070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 -- 172.21.15.81:0/3782603722 shutdown_connections 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.405+0000 7fed2fa00640 1 -- 172.21.15.81:0/3782603722 wait complete. 2024-09-11T00:44:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.406+0000 7fed2fa00640 1 Processor -- start 2024-09-11T00:44:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 -- start start 2024-09-11T00:44:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed28074860 0x7fed281f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed28152610 0x7fed281eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed28070cf0 con 0x7fed2815a970 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed2815c140 con 0x7fed28152610 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.407+0000 7fed2fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fed280c8090 con 0x7fed28074860 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40056/0 (socket says 172.21.15.81:40056) 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 -- 172.21.15.81:0/3587700316 learned_addr learned my addr 172.21.15.81:0/3587700316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed27e00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed28152610 0x7fed281eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2d000640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed28074860 0x7fed281f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 -- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed28074860 msgr2=0x7fed281f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed28074860 0x7fed281f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 -- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed28152610 msgr2=0x7fed281eeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed28152610 0x7fed281eeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 -- 172.21.15.81:0/3587700316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2815b290 con 0x7fed2815a970 2024-09-11T00:44:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.408+0000 7fed2da00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c7a0 tx=0x7fed2000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.409+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20003b70 con 0x7fed2815a970 2024-09-11T00:44:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.409+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed20003d10 con 0x7fed2815a970 2024-09-11T00:44:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.409+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2000aa50 con 0x7fed2815a970 2024-09-11T00:44:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.409+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed28143c50 con 0x7fed2815a970 2024-09-11T00:44:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.409+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed281f2010 con 0x7fed2815a970 2024-09-11T00:44:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.410+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed281529f0 con 0x7fed2815a970 2024-09-11T00:44:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.411+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fed2000abf0 con 0x7fed2815a970 2024-09-11T00:44:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.412+0000 7fed24c00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 0x7fed0807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.412+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fed20099ea0 con 0x7fed2815a970 2024-09-11T00:44:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.412+0000 7fed2d000640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 0x7fed0807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.413+0000 7fed2d000640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 0x7fed0807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed1c034000 tx=0x7fed1c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.416+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fed20061f40 con 0x7fed2815a970 2024-09-11T00:44:57.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.599+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed280c2a70 con 0x7fed08077f70 2024-09-11T00:44:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.606+0000 7fed24c00640 1 -- 172.21.15.81:0/3587700316 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332616 (secure 0 0 0) 0x7fed280c2a70 con 0x7fed08077f70 2024-09-11T00:44:57.611 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 msgr2=0x7fed0807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 0x7fed0807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed1c034000 tx=0x7fed1c004730 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 msgr2=0x7fed28142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c7a0 tx=0x7fed2000cc60 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 shutdown_connections 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fed08077f70 0x7fed0807a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed2815a970 0x7fed28142e40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed28152610 0x7fed281eeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 --2- 172.21.15.81:0/3587700316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed28074860 0x7fed281f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 >> 172.21.15.81:0/3587700316 conn(0x7fed280700f0 msgr2=0x7fed280c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 shutdown_connections 2024-09-11T00:44:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.610+0000 7fed2fa00640 1 -- 172.21.15.81:0/3587700316 wait complete. 2024-09-11T00:44:57.628 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-11T00:44:57.509324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218648,"kb_used_data":2412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756072,"statfs":{"total":773094113280,"available":772870217728,"internally_reserved":0,"allocated":2469888,"data_stored":2081825,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.690007"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.507209+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T00:44:56.507209+0000","last_peered":"2024-09-11T00:44:56.507209+0000","last_clean":"2024-09-11T00:44:56.507209+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T00:44:56.507209+0000","last_undegraded":"2024-09-11T00:44:56.507209+0000","last_fullsized":"2024-09-11T00:44:56.507209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271401+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T00:44:23.271401+0000","last_peered":"2024-09-11T00:44:23.271401+0000","last_clean":"2024-09-11T00:44:23.271401+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T00:44:23.271401+0000","last_undegraded":"2024-09-11T00:44:23.271401+0000","last_fullsized":"2024-09-11T00:44:23.271401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377462+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T00:44:22.377462+0000","last_peered":"2024-09-11T00:44:22.377462+0000","last_clean":"2024-09-11T00:44:22.377462+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T00:44:22.377462+0000","last_undegraded":"2024-09-11T00:44:22.377462+0000","last_fullsized":"2024-09-11T00:44:22.377462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271497+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T00:44:23.271497+0000","last_peered":"2024-09-11T00:44:23.271497+0000","last_clean":"2024-09-11T00:44:23.271497+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T00:44:23.271497+0000","last_undegraded":"2024-09-11T00:44:23.271497+0000","last_fullsized":"2024-09-11T00:44:23.271497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271653+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T00:44:23.271653+0000","last_peered":"2024-09-11T00:44:23.271653+0000","last_clean":"2024-09-11T00:44:23.271653+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T00:44:23.271653+0000","last_undegraded":"2024-09-11T00:44:23.271653+0000","last_fullsized":"2024-09-11T00:44:23.271653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379284+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T00:44:22.379284+0000","last_peered":"2024-09-11T00:44:22.379284+0000","last_clean":"2024-09-11T00:44:22.379284+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T00:44:22.379284+0000","last_undegraded":"2024-09-11T00:44:22.379284+0000","last_fullsized":"2024-09-11T00:44:22.379284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379155+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T00:44:22.379155+0000","last_peered":"2024-09-11T00:44:22.379155+0000","last_clean":"2024-09-11T00:44:22.379155+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T00:44:22.379155+0000","last_undegraded":"2024-09-11T00:44:22.379155+0000","last_fullsized":"2024-09-11T00:44:22.379155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337286+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T00:44:23.337286+0000","last_peered":"2024-09-11T00:44:23.337286+0000","last_clean":"2024-09-11T00:44:23.337286+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T00:44:23.337286+0000","last_undegraded":"2024-09-11T00:44:23.337286+0000","last_fullsized":"2024-09-11T00:44:23.337286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379482+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T00:44:22.379482+0000","last_peered":"2024-09-11T00:44:22.379482+0000","last_clean":"2024-09-11T00:44:22.379482+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T00:44:22.379482+0000","last_undegraded":"2024-09-11T00:44:22.379482+0000","last_fullsized":"2024-09-11T00:44:22.379482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379314+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T00:44:22.379314+0000","last_peered":"2024-09-11T00:44:22.379314+0000","last_clean":"2024-09-11T00:44:22.379314+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T00:44:22.379314+0000","last_undegraded":"2024-09-11T00:44:22.379314+0000","last_fullsized":"2024-09-11T00:44:22.379314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278714+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T00:44:23.278714+0000","last_peered":"2024-09-11T00:44:23.278714+0000","last_clean":"2024-09-11T00:44:23.278714+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T00:44:23.278714+0000","last_undegraded":"2024-09-11T00:44:23.278714+0000","last_fullsized":"2024-09-11T00:44:23.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379166+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T00:44:22.379166+0000","last_peered":"2024-09-11T00:44:22.379166+0000","last_clean":"2024-09-11T00:44:22.379166+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T00:44:22.379166+0000","last_undegraded":"2024-09-11T00:44:22.379166+0000","last_fullsized":"2024-09-11T00:44:22.379166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278382+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T00:44:23.278382+0000","last_peered":"2024-09-11T00:44:23.278382+0000","last_clean":"2024-09-11T00:44:23.278382+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T00:44:23.278382+0000","last_undegraded":"2024-09-11T00:44:23.278382+0000","last_fullsized":"2024-09-11T00:44:23.278382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278806+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T00:44:23.278806+0000","last_peered":"2024-09-11T00:44:23.278806+0000","last_clean":"2024-09-11T00:44:23.278806+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T00:44:23.278806+0000","last_undegraded":"2024-09-11T00:44:23.278806+0000","last_fullsized":"2024-09-11T00:44:23.278806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278469+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T00:44:23.278469+0000","last_peered":"2024-09-11T00:44:23.278469+0000","last_clean":"2024-09-11T00:44:23.278469+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T00:44:23.278469+0000","last_undegraded":"2024-09-11T00:44:23.278469+0000","last_fullsized":"2024-09-11T00:44:23.278469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378316+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T00:44:22.378316+0000","last_peered":"2024-09-11T00:44:22.378316+0000","last_clean":"2024-09-11T00:44:22.378316+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T00:44:22.378316+0000","last_undegraded":"2024-09-11T00:44:22.378316+0000","last_fullsized":"2024-09-11T00:44:22.378316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337842+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T00:44:23.337842+0000","last_peered":"2024-09-11T00:44:23.337842+0000","last_clean":"2024-09-11T00:44:23.337842+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T00:44:23.337842+0000","last_undegraded":"2024-09-11T00:44:23.337842+0000","last_fullsized":"2024-09-11T00:44:23.337842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379118+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T00:44:22.379118+0000","last_peered":"2024-09-11T00:44:22.379118+0000","last_clean":"2024-09-11T00:44:22.379118+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T00:44:22.379118+0000","last_undegraded":"2024-09-11T00:44:22.379118+0000","last_fullsized":"2024-09-11T00:44:22.379118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.505789+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T00:44:56.505789+0000","last_peered":"2024-09-11T00:44:56.505789+0000","last_clean":"2024-09-11T00:44:56.505789+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T00:44:56.505789+0000","last_undegraded":"2024-09-11T00:44:56.505789+0000","last_fullsized":"2024-09-11T00:44:56.505789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506972+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T00:44:56.506972+0000","last_peered":"2024-09-11T00:44:56.506972+0000","last_clean":"2024-09-11T00:44:56.506972+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T00:44:56.506972+0000","last_undegraded":"2024-09-11T00:44:56.506972+0000","last_fullsized":"2024-09-11T00:44:56.506972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378090+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T00:44:22.378090+0000","last_peered":"2024-09-11T00:44:22.378090+0000","last_clean":"2024-09-11T00:44:22.378090+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T00:44:22.378090+0000","last_undegraded":"2024-09-11T00:44:22.378090+0000","last_fullsized":"2024-09-11T00:44:22.378090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278227+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T00:44:23.278227+0000","last_peered":"2024-09-11T00:44:23.278227+0000","last_clean":"2024-09-11T00:44:23.278227+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T00:44:23.278227+0000","last_undegraded":"2024-09-11T00:44:23.278227+0000","last_fullsized":"2024-09-11T00:44:23.278227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378257+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T00:44:22.378257+0000","last_peered":"2024-09-11T00:44:22.378257+0000","last_clean":"2024-09-11T00:44:22.378257+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T00:44:22.378257+0000","last_undegraded":"2024-09-11T00:44:22.378257+0000","last_fullsized":"2024-09-11T00:44:22.378257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379986+0000","last_change":"2024-09-11T00:44:21.375656+0000","last_active":"2024-09-11T00:44:22.379986+0000","last_peered":"2024-09-11T00:44:22.379986+0000","last_clean":"2024-09-11T00:44:22.379986+0000","last_became_active":"2024-09-11T00:44:21.375258+0000","last_became_peered":"2024-09-11T00:44:21.375258+0000","last_unstale":"2024-09-11T00:44:22.379986+0000","last_undegraded":"2024-09-11T00:44:22.379986+0000","last_fullsized":"2024-09-11T00:44:22.379986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:30.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506360+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T00:44:56.506360+0000","last_peered":"2024-09-11T00:44:56.506360+0000","last_clean":"2024-09-11T00:44:56.506360+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T00:44:56.506360+0000","last_undegraded":"2024-09-11T00:44:56.506360+0000","last_fullsized":"2024-09-11T00:44:56.506360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278894+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T00:44:23.278894+0000","last_peered":"2024-09-11T00:44:23.278894+0000","last_clean":"2024-09-11T00:44:23.278894+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T00:44:23.278894+0000","last_undegraded":"2024-09-11T00:44:23.278894+0000","last_fullsized":"2024-09-11T00:44:23.278894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378852+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T00:44:22.378852+0000","last_peered":"2024-09-11T00:44:22.378852+0000","last_clean":"2024-09-11T00:44:22.378852+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T00:44:22.378852+0000","last_undegraded":"2024-09-11T00:44:22.378852+0000","last_fullsized":"2024-09-11T00:44:22.378852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.507032+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T00:44:56.507032+0000","last_peered":"2024-09-11T00:44:56.507032+0000","last_clean":"2024-09-11T00:44:56.507032+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T00:44:56.507032+0000","last_undegraded":"2024-09-11T00:44:56.507032+0000","last_fullsized":"2024-09-11T00:44:56.507032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506462+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T00:44:56.506462+0000","last_peered":"2024-09-11T00:44:56.506462+0000","last_clean":"2024-09-11T00:44:56.506462+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T00:44:56.506462+0000","last_undegraded":"2024-09-11T00:44:56.506462+0000","last_fullsized":"2024-09-11T00:44:56.506462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.505740+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T00:44:56.505740+0000","last_peered":"2024-09-11T00:44:56.505740+0000","last_clean":"2024-09-11T00:44:56.505740+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T00:44:56.505740+0000","last_undegraded":"2024-09-11T00:44:56.505740+0000","last_fullsized":"2024-09-11T00:44:56.505740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338203+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T00:44:23.338203+0000","last_peered":"2024-09-11T00:44:23.338203+0000","last_clean":"2024-09-11T00:44:23.338203+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T00:44:23.338203+0000","last_undegraded":"2024-09-11T00:44:23.338203+0000","last_fullsized":"2024-09-11T00:44:23.338203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.279058+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T00:44:23.279058+0000","last_peered":"2024-09-11T00:44:23.279058+0000","last_clean":"2024-09-11T00:44:23.279058+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T00:44:23.279058+0000","last_undegraded":"2024-09-11T00:44:23.279058+0000","last_fullsized":"2024-09-11T00:44:23.279058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337744+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T00:44:23.337744+0000","last_peered":"2024-09-11T00:44:23.337744+0000","last_clean":"2024-09-11T00:44:23.337744+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T00:44:23.337744+0000","last_undegraded":"2024-09-11T00:44:23.337744+0000","last_fullsized":"2024-09-11T00:44:23.337744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378452+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T00:44:22.378452+0000","last_peered":"2024-09-11T00:44:22.378452+0000","last_clean":"2024-09-11T00:44:22.378452+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T00:44:22.378452+0000","last_undegraded":"2024-09-11T00:44:22.378452+0000","last_fullsized":"2024-09-11T00:44:22.378452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271025+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T00:44:23.271025+0000","last_peered":"2024-09-11T00:44:23.271025+0000","last_clean":"2024-09-11T00:44:23.271025+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T00:44:23.271025+0000","last_undegraded":"2024-09-11T00:44:23.271025+0000","last_fullsized":"2024-09-11T00:44:23.271025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337503+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T00:44:23.337503+0000","last_peered":"2024-09-11T00:44:23.337503+0000","last_clean":"2024-09-11T00:44:23.337503+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T00:44:23.337503+0000","last_undegraded":"2024-09-11T00:44:23.337503+0000","last_fullsized":"2024-09-11T00:44:23.337503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378795+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T00:44:22.378795+0000","last_peered":"2024-09-11T00:44:22.378795+0000","last_clean":"2024-09-11T00:44:22.378795+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T00:44:22.378795+0000","last_undegraded":"2024-09-11T00:44:22.378795+0000","last_fullsized":"2024-09-11T00:44:22.378795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278702+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T00:44:23.278702+0000","last_peered":"2024-09-11T00:44:23.278702+0000","last_clean":"2024-09-11T00:44:23.278702+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T00:44:23.278702+0000","last_undegraded":"2024-09-11T00:44:23.278702+0000","last_fullsized":"2024-09-11T00:44:23.278702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338104+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T00:44:23.338104+0000","last_peered":"2024-09-11T00:44:23.338104+0000","last_clean":"2024-09-11T00:44:23.338104+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T00:44:23.338104+0000","last_undegraded":"2024-09-11T00:44:23.338104+0000","last_fullsized":"2024-09-11T00:44:23.338104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270711+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T00:44:23.270711+0000","last_peered":"2024-09-11T00:44:23.270711+0000","last_clean":"2024-09-11T00:44:23.270711+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T00:44:23.270711+0000","last_undegraded":"2024-09-11T00:44:23.270711+0000","last_fullsized":"2024-09-11T00:44:23.270711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377716+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T00:44:22.377716+0000","last_peered":"2024-09-11T00:44:22.377716+0000","last_clean":"2024-09-11T00:44:22.377716+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T00:44:22.377716+0000","last_undegraded":"2024-09-11T00:44:22.377716+0000","last_fullsized":"2024-09-11T00:44:22.377716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338134+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T00:44:23.338134+0000","last_peered":"2024-09-11T00:44:23.338134+0000","last_clean":"2024-09-11T00:44:23.338134+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T00:44:23.338134+0000","last_undegraded":"2024-09-11T00:44:23.338134+0000","last_fullsized":"2024-09-11T00:44:23.338134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337469+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T00:44:23.337469+0000","last_peered":"2024-09-11T00:44:23.337469+0000","last_clean":"2024-09-11T00:44:23.337469+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T00:44:23.337469+0000","last_undegraded":"2024-09-11T00:44:23.337469+0000","last_fullsized":"2024-09-11T00:44:23.337469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278366+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T00:44:23.278366+0000","last_peered":"2024-09-11T00:44:23.278366+0000","last_clean":"2024-09-11T00:44:23.278366+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T00:44:23.278366+0000","last_undegraded":"2024-09-11T00:44:23.278366+0000","last_fullsized":"2024-09-11T00:44:23.278366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271176+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T00:44:23.271176+0000","last_peered":"2024-09-11T00:44:23.271176+0000","last_clean":"2024-09-11T00:44:23.271176+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T00:44:23.271176+0000","last_undegraded":"2024-09-11T00:44:23.271176+0000","last_fullsized":"2024-09-11T00:44:23.271176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.505902+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T00:44:56.505902+0000","last_peered":"2024-09-11T00:44:56.505902+0000","last_clean":"2024-09-11T00:44:56.505902+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T00:44:56.505902+0000","last_undegraded":"2024-09-11T00:44:56.505902+0000","last_fullsized":"2024-09-11T00:44:56.505902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278965+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T00:44:23.278965+0000","last_peered":"2024-09-11T00:44:23.278965+0000","last_clean":"2024-09-11T00:44:23.278965+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T00:44:23.278965+0000","last_undegraded":"2024-09-11T00:44:23.278965+0000","last_fullsized":"2024-09-11T00:44:23.278965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336942+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T00:44:23.336942+0000","last_peered":"2024-09-11T00:44:23.336942+0000","last_clean":"2024-09-11T00:44:23.336942+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T00:44:23.336942+0000","last_undegraded":"2024-09-11T00:44:23.336942+0000","last_fullsized":"2024-09-11T00:44:23.336942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278974+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T00:44:23.278974+0000","last_peered":"2024-09-11T00:44:23.278974+0000","last_clean":"2024-09-11T00:44:23.278974+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T00:44:23.278974+0000","last_undegraded":"2024-09-11T00:44:23.278974+0000","last_fullsized":"2024-09-11T00:44:23.278974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278822+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T00:44:23.278822+0000","last_peered":"2024-09-11T00:44:23.278822+0000","last_clean":"2024-09-11T00:44:23.278822+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T00:44:23.278822+0000","last_undegraded":"2024-09-11T00:44:23.278822+0000","last_fullsized":"2024-09-11T00:44:23.278822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338295+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T00:44:23.338295+0000","last_peered":"2024-09-11T00:44:23.338295+0000","last_clean":"2024-09-11T00:44:23.338295+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T00:44:23.338295+0000","last_undegraded":"2024-09-11T00:44:23.338295+0000","last_fullsized":"2024-09-11T00:44:23.338295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379377+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T00:44:22.379377+0000","last_peered":"2024-09-11T00:44:22.379377+0000","last_clean":"2024-09-11T00:44:22.379377+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T00:44:22.379377+0000","last_undegraded":"2024-09-11T00:44:22.379377+0000","last_fullsized":"2024-09-11T00:44:22.379377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379199+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T00:44:22.379199+0000","last_peered":"2024-09-11T00:44:22.379199+0000","last_clean":"2024-09-11T00:44:22.379199+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T00:44:22.379199+0000","last_undegraded":"2024-09-11T00:44:22.379199+0000","last_fullsized":"2024-09-11T00:44:22.379199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271440+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T00:44:23.271440+0000","last_peered":"2024-09-11T00:44:23.271440+0000","last_clean":"2024-09-11T00:44:23.271440+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T00:44:23.271440+0000","last_undegraded":"2024-09-11T00:44:23.271440+0000","last_fullsized":"2024-09-11T00:44:23.271440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271007+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T00:44:23.271007+0000","last_peered":"2024-09-11T00:44:23.271007+0000","last_clean":"2024-09-11T00:44:23.271007+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T00:44:23.271007+0000","last_undegraded":"2024-09-11T00:44:23.271007+0000","last_fullsized":"2024-09-11T00:44:23.271007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379275+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T00:44:22.379275+0000","last_peered":"2024-09-11T00:44:22.379275+0000","last_clean":"2024-09-11T00:44:22.379275+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T00:44:22.379275+0000","last_undegraded":"2024-09-11T00:44:22.379275+0000","last_fullsized":"2024-09-11T00:44:22.379275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506401+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T00:44:56.506401+0000","last_peered":"2024-09-11T00:44:56.506401+0000","last_clean":"2024-09-11T00:44:56.506401+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T00:44:56.506401+0000","last_undegraded":"2024-09-11T00:44:56.506401+0000","last_fullsized":"2024-09-11T00:44:56.506401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278107+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T00:44:23.278107+0000","last_peered":"2024-09-11T00:44:23.278107+0000","last_clean":"2024-09-11T00:44:23.278107+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T00:44:23.278107+0000","last_undegraded":"2024-09-11T00:44:23.278107+0000","last_fullsized":"2024-09-11T00:44:23.278107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380138+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T00:44:22.380138+0000","last_peered":"2024-09-11T00:44:22.380138+0000","last_clean":"2024-09-11T00:44:22.380138+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T00:44:22.380138+0000","last_undegraded":"2024-09-11T00:44:22.380138+0000","last_fullsized":"2024-09-11T00:44:22.380138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379343+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T00:44:22.379343+0000","last_peered":"2024-09-11T00:44:22.379343+0000","last_clean":"2024-09-11T00:44:22.379343+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T00:44:22.379343+0000","last_undegraded":"2024-09-11T00:44:22.379343+0000","last_fullsized":"2024-09-11T00:44:22.379343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336913+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T00:44:23.336913+0000","last_peered":"2024-09-11T00:44:23.336913+0000","last_clean":"2024-09-11T00:44:23.336913+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T00:44:23.336913+0000","last_undegraded":"2024-09-11T00:44:23.336913+0000","last_fullsized":"2024-09-11T00:44:23.336913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.505870+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T00:44:56.505870+0000","last_peered":"2024-09-11T00:44:56.505870+0000","last_clean":"2024-09-11T00:44:56.505870+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T00:44:56.505870+0000","last_undegraded":"2024-09-11T00:44:56.505870+0000","last_fullsized":"2024-09-11T00:44:56.505870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271464+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T00:44:23.271464+0000","last_peered":"2024-09-11T00:44:23.271464+0000","last_clean":"2024-09-11T00:44:23.271464+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T00:44:23.271464+0000","last_undegraded":"2024-09-11T00:44:23.271464+0000","last_fullsized":"2024-09-11T00:44:23.271464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337021+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T00:44:23.337021+0000","last_peered":"2024-09-11T00:44:23.337021+0000","last_clean":"2024-09-11T00:44:23.337021+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T00:44:23.337021+0000","last_undegraded":"2024-09-11T00:44:23.337021+0000","last_fullsized":"2024-09-11T00:44:23.337021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378445+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T00:44:22.378445+0000","last_peered":"2024-09-11T00:44:22.378445+0000","last_clean":"2024-09-11T00:44:22.378445+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T00:44:22.378445+0000","last_undegraded":"2024-09-11T00:44:22.378445+0000","last_fullsized":"2024-09-11T00:44:22.378445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271704+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T00:44:23.271704+0000","last_peered":"2024-09-11T00:44:23.271704+0000","last_clean":"2024-09-11T00:44:23.271704+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T00:44:23.271704+0000","last_undegraded":"2024-09-11T00:44:23.271704+0000","last_fullsized":"2024-09-11T00:44:23.271704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278490+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T00:44:23.278490+0000","last_peered":"2024-09-11T00:44:23.278490+0000","last_clean":"2024-09-11T00:44:23.278490+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T00:44:23.278490+0000","last_undegraded":"2024-09-11T00:44:23.278490+0000","last_fullsized":"2024-09-11T00:44:23.278490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278601+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T00:44:23.278601+0000","last_peered":"2024-09-11T00:44:23.278601+0000","last_clean":"2024-09-11T00:44:23.278601+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T00:44:23.278601+0000","last_undegraded":"2024-09-11T00:44:23.278601+0000","last_fullsized":"2024-09-11T00:44:23.278601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337774+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T00:44:23.337774+0000","last_peered":"2024-09-11T00:44:23.337774+0000","last_clean":"2024-09-11T00:44:23.337774+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T00:44:23.337774+0000","last_undegraded":"2024-09-11T00:44:23.337774+0000","last_fullsized":"2024-09-11T00:44:23.337774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337697+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T00:44:23.337697+0000","last_peered":"2024-09-11T00:44:23.337697+0000","last_clean":"2024-09-11T00:44:23.337697+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T00:44:23.337697+0000","last_undegraded":"2024-09-11T00:44:23.337697+0000","last_fullsized":"2024-09-11T00:44:23.337697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378391+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T00:44:22.378391+0000","last_peered":"2024-09-11T00:44:22.378391+0000","last_clean":"2024-09-11T00:44:22.378391+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T00:44:22.378391+0000","last_undegraded":"2024-09-11T00:44:22.378391+0000","last_fullsized":"2024-09-11T00:44:22.378391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278761+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T00:44:23.278761+0000","last_peered":"2024-09-11T00:44:23.278761+0000","last_clean":"2024-09-11T00:44:23.278761+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T00:44:23.278761+0000","last_undegraded":"2024-09-11T00:44:23.278761+0000","last_fullsized":"2024-09-11T00:44:23.278761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378954+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T00:44:22.378954+0000","last_peered":"2024-09-11T00:44:22.378954+0000","last_clean":"2024-09-11T00:44:22.378954+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T00:44:22.378954+0000","last_undegraded":"2024-09-11T00:44:22.378954+0000","last_fullsized":"2024-09-11T00:44:22.378954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:32.110385+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T00:44:32.110385+0000","last_peered":"2024-09-11T00:44:32.110385+0000","last_clean":"2024-09-11T00:44:32.110385+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T00:44:32.110385+0000","last_undegraded":"2024-09-11T00:44:32.110385+0000","last_fullsized":"2024-09-11T00:44:32.110385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.505658+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T00:44:56.505658+0000","last_peered":"2024-09-11T00:44:56.505658+0000","last_clean":"2024-09-11T00:44:56.505658+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T00:44:56.505658+0000","last_undegraded":"2024-09-11T00:44:56.505658+0000","last_fullsized":"2024-09-11T00:44:56.505658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278962+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T00:44:23.278962+0000","last_peered":"2024-09-11T00:44:23.278962+0000","last_clean":"2024-09-11T00:44:23.278962+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T00:44:23.278962+0000","last_undegraded":"2024-09-11T00:44:23.278962+0000","last_fullsized":"2024-09-11T00:44:23.278962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378147+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T00:44:22.378147+0000","last_peered":"2024-09-11T00:44:22.378147+0000","last_clean":"2024-09-11T00:44:22.378147+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T00:44:22.378147+0000","last_undegraded":"2024-09-11T00:44:22.378147+0000","last_fullsized":"2024-09-11T00:44:22.378147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379536+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T00:44:22.379536+0000","last_peered":"2024-09-11T00:44:22.379536+0000","last_clean":"2024-09-11T00:44:22.379536+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T00:44:22.379536+0000","last_undegraded":"2024-09-11T00:44:22.379536+0000","last_fullsized":"2024-09-11T00:44:22.379536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271711+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T00:44:23.271711+0000","last_peered":"2024-09-11T00:44:23.271711+0000","last_clean":"2024-09-11T00:44:23.271711+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T00:44:23.271711+0000","last_undegraded":"2024-09-11T00:44:23.271711+0000","last_fullsized":"2024-09-11T00:44:23.271711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378909+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T00:44:22.378909+0000","last_peered":"2024-09-11T00:44:22.378909+0000","last_clean":"2024-09-11T00:44:22.378909+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T00:44:22.378909+0000","last_undegraded":"2024-09-11T00:44:22.378909+0000","last_fullsized":"2024-09-11T00:44:22.378909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377355+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T00:44:22.377355+0000","last_peered":"2024-09-11T00:44:22.377355+0000","last_clean":"2024-09-11T00:44:22.377355+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T00:44:22.377355+0000","last_undegraded":"2024-09-11T00:44:22.377355+0000","last_fullsized":"2024-09-11T00:44:22.377355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.380052+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T00:44:22.380052+0000","last_peered":"2024-09-11T00:44:22.380052+0000","last_clean":"2024-09-11T00:44:22.380052+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T00:44:22.380052+0000","last_undegraded":"2024-09-11T00:44:22.380052+0000","last_fullsized":"2024-09-11T00:44:22.380052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337474+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T00:44:23.337474+0000","last_peered":"2024-09-11T00:44:23.337474+0000","last_clean":"2024-09-11T00:44:23.337474+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T00:44:23.337474+0000","last_undegraded":"2024-09-11T00:44:23.337474+0000","last_fullsized":"2024-09-11T00:44:23.337474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506762+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T00:44:56.506762+0000","last_peered":"2024-09-11T00:44:56.506762+0000","last_clean":"2024-09-11T00:44:56.506762+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T00:44:56.506762+0000","last_undegraded":"2024-09-11T00:44:56.506762+0000","last_fullsized":"2024-09-11T00:44:56.506762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506247+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T00:44:56.506247+0000","last_peered":"2024-09-11T00:44:56.506247+0000","last_clean":"2024-09-11T00:44:56.506247+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T00:44:56.506247+0000","last_undegraded":"2024-09-11T00:44:56.506247+0000","last_fullsized":"2024-09-11T00:44:56.506247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506870+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T00:44:56.506870+0000","last_peered":"2024-09-11T00:44:56.506870+0000","last_clean":"2024-09-11T00:44:56.506870+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T00:44:56.506870+0000","last_undegraded":"2024-09-11T00:44:56.506870+0000","last_fullsized":"2024-09-11T00:44:56.506870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278312+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T00:44:23.278312+0000","last_peered":"2024-09-11T00:44:23.278312+0000","last_clean":"2024-09-11T00:44:23.278312+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T00:44:23.278312+0000","last_undegraded":"2024-09-11T00:44:23.278312+0000","last_fullsized":"2024-09-11T00:44:23.278312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278804+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T00:44:23.278804+0000","last_peered":"2024-09-11T00:44:23.278804+0000","last_clean":"2024-09-11T00:44:23.278804+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T00:44:23.278804+0000","last_undegraded":"2024-09-11T00:44:23.278804+0000","last_fullsized":"2024-09-11T00:44:23.278804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270790+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T00:44:23.270790+0000","last_peered":"2024-09-11T00:44:23.270790+0000","last_clean":"2024-09-11T00:44:23.270790+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T00:44:23.270790+0000","last_undegraded":"2024-09-11T00:44:23.270790+0000","last_fullsized":"2024-09-11T00:44:23.270790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337517+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T00:44:23.337517+0000","last_peered":"2024-09-11T00:44:23.337517+0000","last_clean":"2024-09-11T00:44:23.337517+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T00:44:23.337517+0000","last_undegraded":"2024-09-11T00:44:23.337517+0000","last_fullsized":"2024-09-11T00:44:23.337517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278506+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T00:44:23.278506+0000","last_peered":"2024-09-11T00:44:23.278506+0000","last_clean":"2024-09-11T00:44:23.278506+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T00:44:23.278506+0000","last_undegraded":"2024-09-11T00:44:23.278506+0000","last_fullsized":"2024-09-11T00:44:23.278506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.508001+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T00:44:56.508001+0000","last_peered":"2024-09-11T00:44:56.508001+0000","last_clean":"2024-09-11T00:44:56.508001+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T00:44:56.508001+0000","last_undegraded":"2024-09-11T00:44:56.508001+0000","last_fullsized":"2024-09-11T00:44:56.508001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.506193+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T00:44:56.506193+0000","last_peered":"2024-09-11T00:44:56.506193+0000","last_clean":"2024-09-11T00:44:56.506193+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T00:44:56.506193+0000","last_undegraded":"2024-09-11T00:44:56.506193+0000","last_fullsized":"2024-09-11T00:44:56.506193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271268+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T00:44:23.271268+0000","last_peered":"2024-09-11T00:44:23.271268+0000","last_clean":"2024-09-11T00:44:23.271268+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T00:44:23.271268+0000","last_undegraded":"2024-09-11T00:44:23.271268+0000","last_fullsized":"2024-09-11T00:44:23.271268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336983+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T00:44:23.336983+0000","last_peered":"2024-09-11T00:44:23.336983+0000","last_clean":"2024-09-11T00:44:23.336983+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T00:44:23.336983+0000","last_undegraded":"2024-09-11T00:44:23.336983+0000","last_fullsized":"2024-09-11T00:44:23.336983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377923+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T00:44:22.377923+0000","last_peered":"2024-09-11T00:44:22.377923+0000","last_clean":"2024-09-11T00:44:22.377923+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T00:44:22.377923+0000","last_undegraded":"2024-09-11T00:44:22.377923+0000","last_fullsized":"2024-09-11T00:44:22.377923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379549+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T00:44:22.379549+0000","last_peered":"2024-09-11T00:44:22.379549+0000","last_clean":"2024-09-11T00:44:22.379549+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T00:44:22.379549+0000","last_undegraded":"2024-09-11T00:44:22.379549+0000","last_fullsized":"2024-09-11T00:44:22.379549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.377629+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T00:44:22.377629+0000","last_peered":"2024-09-11T00:44:22.377629+0000","last_clean":"2024-09-11T00:44:22.377629+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T00:44:22.377629+0000","last_undegraded":"2024-09-11T00:44:22.377629+0000","last_fullsized":"2024-09-11T00:44:22.377629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278287+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T00:44:23.278287+0000","last_peered":"2024-09-11T00:44:23.278287+0000","last_clean":"2024-09-11T00:44:23.278287+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T00:44:23.278287+0000","last_undegraded":"2024-09-11T00:44:23.278287+0000","last_fullsized":"2024-09-11T00:44:23.278287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270913+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T00:44:23.270913+0000","last_peered":"2024-09-11T00:44:23.270913+0000","last_clean":"2024-09-11T00:44:23.270913+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T00:44:23.270913+0000","last_undegraded":"2024-09-11T00:44:23.270913+0000","last_fullsized":"2024-09-11T00:44:23.270913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.338097+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T00:44:23.338097+0000","last_peered":"2024-09-11T00:44:23.338097+0000","last_clean":"2024-09-11T00:44:23.338097+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T00:44:23.338097+0000","last_undegraded":"2024-09-11T00:44:23.338097+0000","last_fullsized":"2024-09-11T00:44:23.338097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337936+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T00:44:23.337936+0000","last_peered":"2024-09-11T00:44:23.337936+0000","last_clean":"2024-09-11T00:44:23.337936+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T00:44:23.337936+0000","last_undegraded":"2024-09-11T00:44:23.337936+0000","last_fullsized":"2024-09-11T00:44:23.337936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379975+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T00:44:22.379975+0000","last_peered":"2024-09-11T00:44:22.379975+0000","last_clean":"2024-09-11T00:44:22.379975+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T00:44:22.379975+0000","last_undegraded":"2024-09-11T00:44:22.379975+0000","last_fullsized":"2024-09-11T00:44:22.379975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271588+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T00:44:23.271588+0000","last_peered":"2024-09-11T00:44:23.271588+0000","last_clean":"2024-09-11T00:44:23.271588+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T00:44:23.271588+0000","last_undegraded":"2024-09-11T00:44:23.271588+0000","last_fullsized":"2024-09-11T00:44:23.271588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278274+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T00:44:23.278274+0000","last_peered":"2024-09-11T00:44:23.278274+0000","last_clean":"2024-09-11T00:44:23.278274+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T00:44:23.278274+0000","last_undegraded":"2024-09-11T00:44:23.278274+0000","last_fullsized":"2024-09-11T00:44:23.278274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270671+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T00:44:23.270671+0000","last_peered":"2024-09-11T00:44:23.270671+0000","last_clean":"2024-09-11T00:44:23.270671+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T00:44:23.270671+0000","last_undegraded":"2024-09-11T00:44:23.270671+0000","last_fullsized":"2024-09-11T00:44:23.270671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.336922+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T00:44:23.336922+0000","last_peered":"2024-09-11T00:44:23.336922+0000","last_clean":"2024-09-11T00:44:23.336922+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T00:44:23.336922+0000","last_undegraded":"2024-09-11T00:44:23.336922+0000","last_fullsized":"2024-09-11T00:44:23.336922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T00:44:56.507951+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T00:44:56.507951+0000","last_peered":"2024-09-11T00:44:56.507951+0000","last_clean":"2024-09-11T00:44:56.507951+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T00:44:56.507951+0000","last_undegraded":"2024-09-11T00:44:56.507951+0000","last_fullsized":"2024-09-11T00:44:56.507951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379104+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T00:44:22.379104+0000","last_peered":"2024-09-11T00:44:22.379104+0000","last_clean":"2024-09-11T00:44:22.379104+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T00:44:22.379104+0000","last_undegraded":"2024-09-11T00:44:22.379104+0000","last_fullsized":"2024-09-11T00:44:22.379104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278959+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T00:44:23.278959+0000","last_peered":"2024-09-11T00:44:23.278959+0000","last_clean":"2024-09-11T00:44:23.278959+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T00:44:23.278959+0000","last_undegraded":"2024-09-11T00:44:23.278959+0000","last_fullsized":"2024-09-11T00:44:23.278959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378209+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T00:44:22.378209+0000","last_peered":"2024-09-11T00:44:22.378209+0000","last_clean":"2024-09-11T00:44:22.378209+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T00:44:22.378209+0000","last_undegraded":"2024-09-11T00:44:22.378209+0000","last_fullsized":"2024-09-11T00:44:22.378209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278842+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T00:44:23.278842+0000","last_peered":"2024-09-11T00:44:23.278842+0000","last_clean":"2024-09-11T00:44:23.278842+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T00:44:23.278842+0000","last_undegraded":"2024-09-11T00:44:23.278842+0000","last_fullsized":"2024-09-11T00:44:23.278842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.278193+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T00:44:23.278193+0000","last_peered":"2024-09-11T00:44:23.278193+0000","last_clean":"2024-09-11T00:44:23.278193+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T00:44:23.278193+0000","last_undegraded":"2024-09-11T00:44:23.278193+0000","last_fullsized":"2024-09-11T00:44:23.278193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270548+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T00:44:23.270548+0000","last_peered":"2024-09-11T00:44:23.270548+0000","last_clean":"2024-09-11T00:44:23.270548+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T00:44:23.270548+0000","last_undegraded":"2024-09-11T00:44:23.270548+0000","last_fullsized":"2024-09-11T00:44:23.270548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337660+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T00:44:23.337660+0000","last_peered":"2024-09-11T00:44:23.337660+0000","last_clean":"2024-09-11T00:44:23.337660+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T00:44:23.337660+0000","last_undegraded":"2024-09-11T00:44:23.337660+0000","last_fullsized":"2024-09-11T00:44:23.337660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337972+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T00:44:23.337972+0000","last_peered":"2024-09-11T00:44:23.337972+0000","last_clean":"2024-09-11T00:44:23.337972+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T00:44:23.337972+0000","last_undegraded":"2024-09-11T00:44:23.337972+0000","last_fullsized":"2024-09-11T00:44:23.337972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379003+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T00:44:22.379003+0000","last_peered":"2024-09-11T00:44:22.379003+0000","last_clean":"2024-09-11T00:44:22.379003+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T00:44:22.379003+0000","last_undegraded":"2024-09-11T00:44:22.379003+0000","last_fullsized":"2024-09-11T00:44:22.379003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378864+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T00:44:22.378864+0000","last_peered":"2024-09-11T00:44:22.378864+0000","last_clean":"2024-09-11T00:44:22.378864+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T00:44:22.378864+0000","last_undegraded":"2024-09-11T00:44:22.378864+0000","last_fullsized":"2024-09-11T00:44:22.378864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378797+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T00:44:22.378797+0000","last_peered":"2024-09-11T00:44:22.378797+0000","last_clean":"2024-09-11T00:44:22.378797+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T00:44:22.378797+0000","last_undegraded":"2024-09-11T00:44:22.378797+0000","last_fullsized":"2024-09-11T00:44:22.378797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.337461+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T00:44:23.337461+0000","last_peered":"2024-09-11T00:44:23.337461+0000","last_clean":"2024-09-11T00:44:23.337461+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T00:44:23.337461+0000","last_undegraded":"2024-09-11T00:44:23.337461+0000","last_fullsized":"2024-09-11T00:44:23.337461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.270653+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T00:44:23.270653+0000","last_peered":"2024-09-11T00:44:23.270653+0000","last_clean":"2024-09-11T00:44:23.270653+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T00:44:23.270653+0000","last_undegraded":"2024-09-11T00:44:23.270653+0000","last_fullsized":"2024-09-11T00:44:23.270653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378335+0000","last_change":"2024-09-11T00:44:17.347367+0000","last_active":"2024-09-11T00:44:22.378335+0000","last_peered":"2024-09-11T00:44:22.378335+0000","last_clean":"2024-09-11T00:44:22.378335+0000","last_became_active":"2024-09-11T00:44:17.347059+0000","last_became_peered":"2024-09-11T00:44:17.347059+0000","last_unstale":"2024-09-11T00:44:22.378335+0000","last_undegraded":"2024-09-11T00:44:22.378335+0000","last_fullsized":"2024-09-11T00:44:22.378335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379532+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T00:44:22.379532+0000","last_peered":"2024-09-11T00:44:22.379532+0000","last_clean":"2024-09-11T00:44:22.379532+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T00:44:22.379532+0000","last_undegraded":"2024-09-11T00:44:22.379532+0000","last_fullsized":"2024-09-11T00:44:22.379532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.378927+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T00:44:22.378927+0000","last_peered":"2024-09-11T00:44:22.378927+0000","last_clean":"2024-09-11T00:44:22.378927+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T00:44:22.378927+0000","last_undegraded":"2024-09-11T00:44:22.378927+0000","last_fullsized":"2024-09-11T00:44:22.378927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379696+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T00:44:22.379696+0000","last_peered":"2024-09-11T00:44:22.379696+0000","last_clean":"2024-09-11T00:44:22.379696+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T00:44:22.379696+0000","last_undegraded":"2024-09-11T00:44:22.379696+0000","last_fullsized":"2024-09-11T00:44:22.379696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271241+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T00:44:23.271241+0000","last_peered":"2024-09-11T00:44:23.271241+0000","last_clean":"2024-09-11T00:44:23.271241+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T00:44:23.271241+0000","last_undegraded":"2024-09-11T00:44:23.271241+0000","last_fullsized":"2024-09-11T00:44:23.271241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:23.271295+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T00:44:23.271295+0000","last_peered":"2024-09-11T00:44:23.271295+0000","last_clean":"2024-09-11T00:44:23.271295+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T00:44:23.271295+0000","last_undegraded":"2024-09-11T00:44:23.271295+0000","last_fullsized":"2024-09-11T00:44:23.271295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T00:44:22.379159+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T00:44:22.379159+0000","last_peered":"2024-09-11T00:44:22.379159+0000","last_clean":"2024-09-11T00:44:22.379159+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T00:44:22.379159+0000","last_undegraded":"2024-09-11T00:44:22.379159+0000","last_fullsized":"2024-09-11T00:44:22.379159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":701025,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":701003,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":122368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:44:57.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 -- 172.21.15.81:0/2975821238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 msgr2=0x7f2974072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 --2- 172.21.15.81:0/2975821238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f2974072650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f296c009830 tx=0x7f296c02a510 comp rx=0 tx=0).stop 2024-09-11T00:44:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 -- 172.21.15.81:0/2975821238 shutdown_connections 2024-09-11T00:44:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 --2- 172.21.15.81:0/2975821238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f2974072650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 -- 172.21.15.81:0/2975821238 >> 172.21.15.81:0/2975821238 conn(0x7f29740700f0 msgr2=0x7f2974070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.825+0000 7f2979400640 1 -- 172.21.15.81:0/2975821238 shutdown_connections 2024-09-11T00:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.826+0000 7f2979400640 1 -- 172.21.15.81:0/2975821238 wait complete. 2024-09-11T00:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.827+0000 7f2979400640 1 Processor -- start 2024-09-11T00:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.827+0000 7f2979400640 1 -- start start 2024-09-11T00:44:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 0x7f2974147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 0x7f2974150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2974073250 con 0x7f2974154ad0 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f297415b2f0 con 0x7f29740c7fd0 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2979400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f297415a610 con 0x7f29740c7bf0 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2973200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2973200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40072/0 (socket says 172.21.15.81:40072) 2024-09-11T00:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.828+0000 7f2973200640 1 -- 172.21.15.81:0/620558522 learned_addr learned my addr 172.21.15.81:0/620558522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2971e00640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 0x7f2974150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 -- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 msgr2=0x7f2974147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2972800640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 0x7f2974147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 0x7f2974147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 -- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 msgr2=0x7f2974150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 0x7f2974150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 -- 172.21.15.81:0/620558522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297414f5c0 con 0x7f2974154ad0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2971e00640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 0x7f2974150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2972800640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 0x7f2974147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2973200640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f296c009950 tx=0x7f296c033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c031d60 con 0x7f2974154ad0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f296c005020 con 0x7f2974154ad0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297414f2e0 con 0x7f2974154ad0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c005450 con 0x7f2974154ad0 2024-09-11T00:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.829+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29740cbc70 con 0x7f2974154ad0 2024-09-11T00:44:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.831+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2974073ef0 con 0x7f2974154ad0 2024-09-11T00:44:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.832+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f296c0047a0 con 0x7f2974154ad0 2024-09-11T00:44:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.832+0000 7f296aa00640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 0x7f295407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.833+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f296c0bb1d0 con 0x7f2974154ad0 2024-09-11T00:44:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.833+0000 7f2972800640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 0x7f295407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:57.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.834+0000 7f2972800640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 0x7f295407a460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2964004520 tx=0x7f2964009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:57.836+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f296c03f030 con 0x7f2974154ad0 2024-09-11T00:44:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.057+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29740c1fb0 con 0x7f2974154ad0 2024-09-11T00:44:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.058+0000 7f296aa00640 1 -- 172.21.15.81:0/620558522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f296c0839f0 con 0x7f2974154ad0 2024-09-11T00:44:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:58.060 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.060+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 msgr2=0x7f295407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.060+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 0x7f295407a460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2964004520 tx=0x7f2964009040 comp rx=0 tx=0).stop 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.060+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 msgr2=0x7f297414e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.060+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f296c009950 tx=0x7f296c033ce0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 shutdown_connections 2024-09-11T00:44:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2954077fa0 0x7f295407a460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2974154ad0 0x7f297414e7a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29740c7fd0 0x7f2974150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 --2- 172.21.15.81:0/620558522 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29740c7bf0 0x7f2974147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 >> 172.21.15.81:0/620558522 conn(0x7f29740700f0 msgr2=0x7f2974158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 shutdown_connections 2024-09-11T00:44:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.061+0000 7f2979400640 1 -- 172.21.15.81:0/620558522 wait complete. 2024-09-11T00:44:58.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 -- 172.21.15.81:0/2094476816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ca0004800 msgr2=0x7f0ca0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/2094476816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ca0004800 0x7f0ca0004c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009b50 tx=0x7f0ca0005830 comp rx=0 tx=0).stop 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 -- 172.21.15.81:0/2094476816 shutdown_connections 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/2094476816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ca0004800 0x7f0ca0004c80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 -- 172.21.15.81:0/2094476816 >> 172.21.15.81:0/2094476816 conn(0x7f0cbc0700f0 msgr2=0x7f0cbc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 -- 172.21.15.81:0/2094476816 shutdown_connections 2024-09-11T00:44:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.233+0000 7f0cc3c00640 1 -- 172.21.15.81:0/2094476816 wait complete. 2024-09-11T00:44:58.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.235+0000 7f0cc3c00640 1 Processor -- start 2024-09-11T00:44:58.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.235+0000 7f0cc3c00640 1 -- start start 2024-09-11T00:44:58.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cbc14b8a0 0x7f0cbc1f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cbc1f3ef0 0x7f0cbc073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc070cf0 con 0x7f0ca0004800 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc15c140 con 0x7f0cbc1f3ef0 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc3c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc1529f0 con 0x7f0cbc14b8a0 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40086/0 (socket says 172.21.15.81:40086) 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 -- 172.21.15.81:0/480427864 learned_addr learned my addr 172.21.15.81:0/480427864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 -- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cbc14b8a0 msgr2=0x7f0cbc1f39b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cbc14b8a0 0x7f0cbc1f39b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 -- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cbc1f3ef0 msgr2=0x7f0cbc073400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cbc1f3ef0 0x7f0cbc073400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.236+0000 7f0cc1200640 1 -- 172.21.15.81:0/480427864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc074650 con 0x7f0ca0004800 2024-09-11T00:44:58.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cc1200640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006690 tx=0x7f0cac0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:58.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac015020 con 0x7f0ca0004800 2024-09-11T00:44:58.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cac011840 con 0x7f0ca0004800 2024-09-11T00:44:58.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac011c90 con 0x7f0ca0004800 2024-09-11T00:44:58.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc1f4850 con 0x7f0ca0004800 2024-09-11T00:44:58.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.237+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc152ea0 con 0x7f0ca0004800 2024-09-11T00:44:58.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.238+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cbc1f42f0 con 0x7f0ca0004800 2024-09-11T00:44:58.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.239+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0cac01a400 con 0x7f0ca0004800 2024-09-11T00:44:58.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.240+0000 7f0cb8c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 0x7f0c9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.240+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f0cac09af60 con 0x7f0ca0004800 2024-09-11T00:44:58.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.240+0000 7f0cbbe00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 0x7f0c9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:58.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.241+0000 7f0cbbe00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 0x7f0c9c07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8035000 tx=0x7f0ca80046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:58.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.244+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0cbc1f42f0 con 0x7f0ca0004800 2024-09-11T00:44:58.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.462+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cbc073060 con 0x7f0ca0004800 2024-09-11T00:44:58.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.463+0000 7f0cb8c00640 1 -- 172.21.15.81:0/480427864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f0cac01f020 con 0x7f0ca0004800 2024-09-11T00:44:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:58.465 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 msgr2=0x7f0c9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 0x7f0c9c07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8035000 tx=0x7f0ca80046c0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 msgr2=0x7f0cbc14b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006690 tx=0x7f0cac0016f0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 shutdown_connections 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0c9c077f70 0x7f0c9c07a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cbc1f3ef0 0x7f0cbc073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cbc14b8a0 0x7f0cbc1f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 --2- 172.21.15.81:0/480427864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0004800 0x7f0cbc14b180 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 >> 172.21.15.81:0/480427864 conn(0x7f0cbc0700f0 msgr2=0x7f0cbc0c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 shutdown_connections 2024-09-11T00:44:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.466+0000 7f0cc3c00640 1 -- 172.21.15.81:0/480427864 wait complete. 2024-09-11T00:44:58.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:44:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 -- 172.21.15.81:0/3764247018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c004d40 msgr2=0x7f042c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 --2- 172.21.15.81:0/3764247018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c004d40 0x7f042c0051c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f04480711b0 tx=0x7f042c005830 comp rx=0 tx=0).stop 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f0447400640 1 -- 172.21.15.81:0/3764247018 reap_dead start 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 -- 172.21.15.81:0/3764247018 shutdown_connections 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 -- 172.21.15.81:0/3764247018 >> 172.21.15.81:0/3764247018 conn(0x7f04480700f0 msgr2=0x7f0448070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 -- 172.21.15.81:0/3764247018 shutdown_connections 2024-09-11T00:44:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.641+0000 7f044d800640 1 -- 172.21.15.81:0/3764247018 wait complete. 2024-09-11T00:44:58.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.642+0000 7f044d800640 1 Processor -- start 2024-09-11T00:44:58.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.643+0000 7f044d800640 1 -- start start 2024-09-11T00:44:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.643+0000 7f044d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042c004d40 0x7f04480c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f044d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 0x7f04480c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f044d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f044d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0448070cf0 con 0x7f04481f3f70 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f044d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f044815c140 con 0x7f04480c6100 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f044d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f04480c8090 con 0x7f042c004d40 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40110/0 (socket says 172.21.15.81:40110) 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 -- 172.21.15.81:0/2561046550 learned_addr learned my addr 172.21.15.81:0/2561046550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 -- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042c004d40 msgr2=0x7f04480c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042c004d40 0x7f04480c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 -- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 msgr2=0x7f04480c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0446000640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 0x7f04480c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 0x7f04480c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 -- 172.21.15.81:0/2561046550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480c4db0 con 0x7f04481f3f70 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0446000640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 0x7f04480c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.644+0000 7f0447400640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0440009f90 tx=0x7f0440033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.645+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440038040 con 0x7f04481f3f70 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.645+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f044002bbc0 con 0x7f04481f3f70 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.645+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04480c5050 con 0x7f04481f3f70 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.645+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440004d80 con 0x7f04481f3f70 2024-09-11T00:44:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.645+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04480c5610 con 0x7f04481f3f70 2024-09-11T00:44:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.646+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04480b22f0 con 0x7f04481f3f70 2024-09-11T00:44:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.647+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f044003b070 con 0x7f04481f3f70 2024-09-11T00:44:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.648+0000 7f043ea00640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 0x7f042807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.648+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f04400ba6e0 con 0x7f04481f3f70 2024-09-11T00:44:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.648+0000 7f0446a00640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 0x7f042807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.649+0000 7f0446a00640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 0x7f042807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0438009b40 tx=0x7f0438009660 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.652+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f04480b22f0 con 0x7f04481f3f70 2024-09-11T00:44:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.835+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04481529f0 con 0x7f04481f3f70 2024-09-11T00:44:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.836+0000 7f043ea00640 1 -- 172.21.15.81:0/2561046550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7f044004a020 con 0x7f04481f3f70 2024-09-11T00:44:58.838 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:58.838 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:57.502396+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:44:58.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 msgr2=0x7f042807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 0x7f042807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0438009b40 tx=0x7f0438009660 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 msgr2=0x7f04481f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0440009f90 tx=0x7f0440033c10 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 shutdown_connections 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0428077f70 0x7f042807a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04481f3f70 0x7f04481f4420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04480c6100 0x7f04480c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 --2- 172.21.15.81:0/2561046550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042c004d40 0x7f04480c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 >> 172.21.15.81:0/2561046550 conn(0x7f04480700f0 msgr2=0x7f0448150f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 shutdown_connections 2024-09-11T00:44:58.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:58.838+0000 7f044d800640 1 -- 172.21.15.81:0/2561046550 wait complete. 2024-09-11T00:44:58.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-09-11T00:44:59.016 INFO:teuthology.orchestra.run.smithi081.stdout:{"run_dir":"/var/run/ceph"} 2024-09-11T00:44:59.016 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-11T00:44:59.017 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 6190 2024-09-11T00:44:59.017 DEBUG:tasks.quiescer:Yielding 2024-09-11T00:44:59.017 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T00:44:59.033 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:44:59.034 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T00:44:59.034 INFO:tasks.workunit:timeout=3h 2024-09-11T00:44:59.034 INFO:tasks.workunit:cleanup=True 2024-09-11T00:44:59.034 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:59.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:44:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T00:44:59.071 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-11 00:44:22.328210951 +0000 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-11 00:44:32.107191111 +0000 2024-09-11T00:44:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-11T00:44:59.072 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T00:44:59.072 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T00:44:59.177 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:44:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.197+0000 7f1d76600640 1 -- 172.21.15.81:0/2593588813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 msgr2=0x7f1d7006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.197+0000 7f1d76600640 1 --2- 172.21.15.81:0/2593588813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d7006c9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d700c7980 tx=0x7f1d5802a640 comp rx=0 tx=0).stop 2024-09-11T00:44:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 -- 172.21.15.81:0/2593588813 shutdown_connections 2024-09-11T00:44:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 --2- 172.21.15.81:0/2593588813 >> v2:172.21.15.167:3300/0 conn(0x7f1d700c86e0 0x7f1d7006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 --2- 172.21.15.81:0/2593588813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d7006c9e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 --2- 172.21.15.81:0/2593588813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d700c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 -- 172.21.15.81:0/2593588813 >> 172.21.15.81:0/2593588813 conn(0x7f1d700710e0 msgr2=0x7f1d700714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 -- 172.21.15.81:0/2593588813 shutdown_connections 2024-09-11T00:44:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.198+0000 7f1d76600640 1 -- 172.21.15.81:0/2593588813 wait complete. 2024-09-11T00:44:59.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.200+0000 7f1d76600640 1 Processor -- start 2024-09-11T00:44:59.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.200+0000 7f1d76600640 1 -- start start 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d700c86e0 0x7f1d701458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d70145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701592e0 con 0x7f1d70071c00 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d70159000 con 0x7f1d700c86e0 2024-09-11T00:44:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d76600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7006ed50 con 0x7f1d700c9670 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d6f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d6f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40124/0 (socket says 172.21.15.81:40124) 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d6f400640 1 -- 172.21.15.81:0/283995188 learned_addr learned my addr 172.21.15.81:0/283995188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d66a00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d700c86e0 0x7f1d701458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.201+0000 7f1d6fe00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d70145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 -- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 msgr2=0x7f1d70145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d70145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 -- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d700c86e0 msgr2=0x7f1d701458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d700c86e0 0x7f1d701458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 -- 172.21.15.81:0/283995188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d701eee40 con 0x7f1d70071c00 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6fe00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d70145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:44:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d6f400640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e7f0 tx=0x7f1d6000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000ccc0 con 0x7f1d70071c00 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d6000ce80 con 0x7f1d70071c00 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60005280 con 0x7f1d70071c00 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.202+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d700c52c0 con 0x7f1d70071c00 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.203+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7014e1d0 con 0x7f1d70071c00 2024-09-11T00:44:59.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.204+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d700c50f0 con 0x7f1d70071c00 2024-09-11T00:44:59.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.205+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1d60005420 con 0x7f1d70071c00 2024-09-11T00:44:59.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.206+0000 7f1d67e00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 0x7f1d4c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:44:59.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.206+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1d6009aa80 con 0x7f1d70071c00 2024-09-11T00:44:59.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.206+0000 7f1d66a00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 0x7f1d4c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:44:59.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.207+0000 7f1d66a00640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 0x7f1d4c07a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d58033000 tx=0x7f1d58004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:44:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.210+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1d60063210 con 0x7f1d70071c00 2024-09-11T00:44:59.217 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T00:44:59.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.436+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d7006f030 con 0x7f1d70071c00 2024-09-11T00:44:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.437+0000 7f1d67e00640 1 -- 172.21.15.81:0/283995188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f1d60062b10 con 0x7f1d70071c00 2024-09-11T00:44:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:44:59.438 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:44:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 msgr2=0x7f1d4c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 0x7f1d4c07a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d58033000 tx=0x7f1d58004730 comp rx=0 tx=0).stop 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 msgr2=0x7f1d701ee460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e7f0 tx=0x7f1d6000ecb0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 shutdown_connections 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1d4c077f70 0x7f1d4c07a430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d700c9670 0x7f1d70145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d700c86e0 0x7f1d701458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 --2- 172.21.15.81:0/283995188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d70071c00 0x7f1d701ee460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:44:59.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.439+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 >> 172.21.15.81:0/283995188 conn(0x7f1d700710e0 msgr2=0x7f1d700c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:44:59.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.440+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 shutdown_connections 2024-09-11T00:44:59.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:44:59.440+0000 7f1d76600640 1 -- 172.21.15.81:0/283995188 wait complete. 2024-09-11T00:45:00.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:44:16.758683+0000', 'modified': '2024-09-11T00:44:42.883390+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4411': {'gid': 4411, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6835/1821136348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 1821136348}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 1821136348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4411, 'qdb_cluster': [4411]} 2024-09-11T00:45:00.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:45:00.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T00:45:00.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 -- 172.21.15.81:0/1323799848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc80cbe90 msgr2=0x7fafc815e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 --2- 172.21.15.81:0/1323799848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc80cbe90 0x7fafc815e560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fafc80cdac0 tx=0x7fafb402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 -- 172.21.15.81:0/1323799848 shutdown_connections 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 --2- 172.21.15.81:0/1323799848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc80cbe90 0x7fafc815e560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 --2- 172.21.15.81:0/1323799848 >> v2:172.21.15.167:3300/0 conn(0x7fafc81548e0 0x7fafc815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 -- 172.21.15.81:0/1323799848 >> 172.21.15.81:0/1323799848 conn(0x7fafc806ebb0 msgr2=0x7fafc806efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 -- 172.21.15.81:0/1323799848 shutdown_connections 2024-09-11T00:45:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.223+0000 7fafcf000640 1 -- 172.21.15.81:0/1323799848 wait complete. 2024-09-11T00:45:00.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.224+0000 7fafcf000640 1 Processor -- start 2024-09-11T00:45:00.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 -- start start 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc80c4f50 0x7fafc815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafc80cbe90 0x7fafc80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafc815dd60 con 0x7fafc81548e0 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cb280 con 0x7fafc80c4f50 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.225+0000 7fafcf000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fafc80cb5a0 con 0x7fafc80cbe90 2024-09-11T00:45:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40144/0 (socket says 172.21.15.81:40144) 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 -- 172.21.15.81:0/2343552144 learned_addr learned my addr 172.21.15.81:0/2343552144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafcdc00640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc80c4f50 0x7fafc815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafcd200640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafc80cbe90 0x7fafc80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 -- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafc80cbe90 msgr2=0x7fafc80b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafc80cbe90 0x7fafc80b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 -- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc80c4f50 msgr2=0x7fafc815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc80c4f50 0x7fafc815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 -- 172.21.15.81:0/2343552144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc815a3d0 con 0x7fafc81548e0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.226+0000 7fafce600640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fafc000cbc0 tx=0x7fafc000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.227+0000 7fafc5600640 1 -- 172.21.15.81:0/2343552144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0016020 con 0x7fafc81548e0 2024-09-11T00:45:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.227+0000 7fafc5600640 1 -- 172.21.15.81:0/2343552144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc000ae30 con 0x7fafc81548e0 2024-09-11T00:45:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.227+0000 7fafc5600640 1 -- 172.21.15.81:0/2343552144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0012680 con 0x7fafc81548e0 2024-09-11T00:45:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.227+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc815a670 con 0x7fafc81548e0 2024-09-11T00:45:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.227+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc80cff70 con 0x7fafc81548e0 2024-09-11T00:45:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.229+0000 7fafc5600640 1 -- 172.21.15.81:0/2343552144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fafc001b400 con 0x7fafc81548e0 2024-09-11T00:45:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.230+0000 7fafc5600640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 0x7fafa807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.230+0000 7fafd35ec740 1 Processor -- start 2024-09-11T00:45:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.230+0000 7fafc5600640 1 -- 172.21.15.81:0/2343552144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fafc009aa60 con 0x7fafc81548e0 2024-09-11T00:45:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.230+0000 7fafd35ec740 1 -- start start 2024-09-11T00:45:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.230+0000 7fafcdc00640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 0x7fafa807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b03511ff60 0x55b035121850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b0350a5430 con 0x55b035120340 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b0350955d0 con 0x55b035157600 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b035084a00 con 0x55b03511ff60 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafcd200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafcdc00640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 0x7fafa807a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009b30 tx=0x7fafbc005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafcd200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40150/0 (socket says 172.21.15.81:40150) 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafcd200640 1 -- 172.21.15.81:0/3731240911 learned_addr learned my addr 172.21.15.81:0/3731240911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafcdc00640 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b03511ff60 0x55b035121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.231+0000 7fafce600640 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 -- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b03511ff60 msgr2=0x55b035121850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b03511ff60 0x55b035121850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 -- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 msgr2=0x55b035157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 -- 172.21.15.81:0/3731240911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b03504d520 con 0x55b035120340 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafcd200640 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafb402abc0 tx=0x7fafb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8af0a78d4f76a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafba000640 1 -- 172.21.15.81:0/3731240911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4004340 con 0x55b035120340 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafba000640 1 -- 172.21.15.81:0/3731240911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb4005020 con 0x55b035120340 2024-09-11T00:45:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.232+0000 7fafba000640 1 -- 172.21.15.81:0/3731240911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4005470 con 0x55b035120340 2024-09-11T00:45:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 -- 172.21.15.81:0/3731240911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 msgr2=0x55b035121d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafb402abc0 tx=0x7fafb40046c0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 -- 172.21.15.81:0/3731240911 shutdown_connections 2024-09-11T00:45:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b035121d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 --2- 172.21.15.81:0/3731240911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b03511ff60 0x55b035121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 -- 172.21.15.81:0/3731240911 >> 172.21.15.81:0/3731240911 conn(0x55b03511e140 msgr2=0x55b03511f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 -- 172.21.15.81:0/3731240911 shutdown_connections 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.233+0000 7fafd35ec740 1 -- 172.21.15.81:0/3731240911 wait complete. 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.234+0000 7fafd35ec740 1 -- start start 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.234+0000 7fafd35ec740 1 Processor -- start 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035153400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b0351598a0 0x55b035159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b03502b330 con 0x55b035120340 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b035088810 con 0x55b035157600 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b034df5620 con 0x55b0351598a0 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafd35ec740 10 client.0 _ll_register_callbacks cb 0x55b035030420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40154/0 (socket says 172.21.15.81:40154) 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 -- 172.21.15.81:0/1403937079 learned_addr learned my addr 172.21.15.81:0/1403937079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafce600640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b0351598a0 0x55b035159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcd200640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 -- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b0351598a0 msgr2=0x55b035159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b0351598a0 0x55b035159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 -- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 msgr2=0x55b035153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.235+0000 7fafcdc00640 1 -- 172.21.15.81:0/1403937079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b034de6850 con 0x55b035120340 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafcdc00640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0035f0 tx=0x7fafbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d393063ae4b36791 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc027420 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fafbc01d410 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb4005020 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fafbc01d610 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafd35ec740 10 client.4857 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b034e5d6b0 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb4005020 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fafbc02f050 con 0x55b035120340 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafd35ec740 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.236+0000 7fafd35ec740 10 client.4857 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.237+0000 7fafd35ec740 20 client.4857 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.237+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b03517f4b0 0x55b0351818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.237+0000 7fafd35ec740 4 client.4857 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.237+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b035097520 con 0x55b03517f4b0 2024-09-11T00:45:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.237+0000 7fafcd200640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b03517f4b0 0x55b0351818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.238+0000 7fafcd200640 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b03517f4b0 0x55b0351818a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45e05f6e83b26fb7 server_cookie=d7dced3573425fe0 in_seq=0 out_seq=0 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.238+0000 7fafaea00640 10 client.4857 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafaea00640 1 -- 172.21.15.81:0/1403937079 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b035097520 con 0x55b03517f4b0 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafaea00640 10 client.4857 handle_command_reply: tid=0 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 client.4857 shutdown 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 msgr2=0x55b03515aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0035f0 tx=0x7fafbc004730 comp rx=0 tx=0).stop 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 shutdown_connections 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b03517f4b0 0x55b0351818a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b0351598a0 0x55b035159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035157600 0x55b035153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 --2- 172.21.15.81:0/1403937079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035120340 0x55b03515aa80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafaea00640 0 client.4857 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 >> 172.21.15.81:0/1403937079 conn(0x55b03511ff60 msgr2=0x55b03511d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 shutdown_connections 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 1 -- 172.21.15.81:0/1403937079 wait complete. 2024-09-11T00:45:00.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.239+0000 7fafd35ec740 20 client.4857 trim_cache size 0 max 16384 2024-09-11T00:45:00.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.258+0000 7fafd35ec740 1 Processor -- start 2024-09-11T00:45:00.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.258+0000 7fafd35ec740 1 -- start start 2024-09-11T00:45:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 0x55b03511d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035157600 0x55b0351db700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafc81fd2c0 con 0x55b0351598a0 2024-09-11T00:45:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b03515b010 con 0x55b035120340 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b035151290 con 0x55b035157600 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40162/0 (socket says 172.21.15.81:40162) 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 -- 172.21.15.81:0/2927655003 learned_addr learned my addr 172.21.15.81:0/2927655003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafcd200640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035157600 0x55b0351db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafcdc00640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 0x55b03511d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 -- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035157600 msgr2=0x55b0351db700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035157600 0x55b0351db700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 -- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 msgr2=0x55b03511d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 0x55b03511d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafce600640 1 -- 172.21.15.81:0/2927655003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b03515a090 con 0x55b0351598a0 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.259+0000 7fafcdc00640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 0x55b03511d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:45:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafce600640 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafc0098bb0 tx=0x7fafc001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aab1a3083f1e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafb9600640 1 -- 172.21.15.81:0/2927655003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0088020 con 0x55b0351598a0 2024-09-11T00:45:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafb9600640 1 -- 172.21.15.81:0/2927655003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc006bfe0 con 0x55b0351598a0 2024-09-11T00:45:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafb9600640 1 -- 172.21.15.81:0/2927655003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00673c0 con 0x55b0351598a0 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafd35ec740 1 -- 172.21.15.81:0/2927655003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 msgr2=0x55b0351dbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafd35ec740 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafc0098bb0 tx=0x7fafc001d040 comp rx=0 tx=0).stop 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.260+0000 7fafd35ec740 1 -- 172.21.15.81:0/2927655003 shutdown_connections 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b0351598a0 0x55b0351dbc40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035157600 0x55b0351db700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 --2- 172.21.15.81:0/2927655003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b035120340 0x55b03511d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 -- 172.21.15.81:0/2927655003 >> 172.21.15.81:0/2927655003 conn(0x55b03511ff60 msgr2=0x55b035120720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 -- 172.21.15.81:0/2927655003 shutdown_connections 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 -- 172.21.15.81:0/2927655003 wait complete. 2024-09-11T00:45:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 -- start start 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.261+0000 7fafd35ec740 1 Processor -- start 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035120340 0x55b03514f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 0x55b03515e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b035153940 con 0x55b035157600 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b03514d020 con 0x55b0351598a0 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b035176100 con 0x55b035120340 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.262+0000 7fafd35ec740 10 client.0 _ll_register_callbacks cb 0x7fafbc0044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40178/0 (socket says 172.21.15.81:40178) 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 -- 172.21.15.81:0/610065835 learned_addr learned my addr 172.21.15.81:0/610065835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcdc00640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035120340 0x55b03514f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafce600640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 0x55b03515e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 -- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035120340 msgr2=0x55b03514f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035120340 0x55b03514f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 -- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 msgr2=0x55b03515e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 0x55b03515e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 -- 172.21.15.81:0/610065835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b03515be80 con 0x55b035157600 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafce600640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 0x55b03515e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafcd200640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009920 tx=0x7fafb402ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85938ad71cefb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafaea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4054030 con 0x55b035157600 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc006bfe0 con 0x55b035157600 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.263+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fafb40035f0 con 0x55b035157600 2024-09-11T00:45:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fafb40037f0 con 0x55b035157600 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 10 client.4863 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b035150480 con 0x55b035157600 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc006bfe0 con 0x55b035157600 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fafb4003990 con 0x55b035157600 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 10 client.4863 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 10 client.4863 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 20 client.4863 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b0351d96d0 0x55b0351d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 4 client.4863 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.264+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "status"}) -- 0x55b035092fd0 con 0x55b0351d96d0 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafcdc00640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b0351d96d0 0x55b0351d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafcdc00640 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b0351d96d0 0x55b0351d9ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d202dfdd2d6634ca server_cookie=519557db0121d096 in_seq=0 out_seq=0 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafaea00640 10 client.4863 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafaea00640 1 -- 172.21.15.81:0/610065835 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b035092fd0 con 0x55b0351d96d0 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafaea00640 10 client.4863 handle_command_reply: tid=0 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.265+0000 7fafd35ec740 1 client.4863 shutdown 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 msgr2=0x55b03511f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009920 tx=0x7fafb402ac50 comp rx=0 tx=0).stop 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 shutdown_connections 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b0351d96d0 0x55b0351d9ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b0351598a0 0x55b03515e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b035157600 0x55b03511f6f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafaea00640 0 client.4863 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 --2- 172.21.15.81:0/610065835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b035120340 0x55b03514f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 >> 172.21.15.81:0/610065835 conn(0x55b03511ff60 msgr2=0x55b03515b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 shutdown_connections 2024-09-11T00:45:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 1 -- 172.21.15.81:0/610065835 wait complete. 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafd35ec740 20 client.4863 trim_cache size 0 max 16384 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "62a8ae86-7f85-478f-9a99-4c394aac48f1", 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4411, 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-11T00:45:00.273 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 42.940422118000001, 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 29, 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 27, 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 48.961129303 2024-09-11T00:45:00.274 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 msgr2=0x7fafa807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 0x7fafa807a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009b30 tx=0x7fafbc005f90 comp rx=0 tx=0).stop 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 msgr2=0x7fafc81479f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.266+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fafc000cbc0 tx=0x7fafc000a430 comp rx=0 tx=0).stop 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 shutdown_connections 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fafa8077f70 0x7fafa807a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc81548e0 0x7fafc81479f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafc80cbe90 0x7fafc80b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 --2- 172.21.15.81:0/2343552144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafc80c4f50 0x7fafc815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 >> 172.21.15.81:0/2343552144 conn(0x7fafc806ebb0 msgr2=0x7fafc8153550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 shutdown_connections 2024-09-11T00:45:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:00.267+0000 7fafcf000640 1 -- 172.21.15.81:0/2343552144 wait complete. 2024-09-11T00:45:00.283 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-11T00:45:11.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:11.642 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:15.283 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-09-11T00:45:15.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:45:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 -- 172.21.15.81:0/40631106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a70 msgr2=0x7fdc98003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/40631106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a70 0x7fdc98003e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40c8620 tx=0x7fdc98005830 comp rx=0 tx=0).stop 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9200640 1 -- 172.21.15.81:0/40631106 reap_dead start 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 -- 172.21.15.81:0/40631106 shutdown_connections 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 -- 172.21.15.81:0/40631106 >> 172.21.15.81:0/40631106 conn(0x7fdcb406ffd0 msgr2=0x7fdcb40703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 -- 172.21.15.81:0/40631106 shutdown_connections 2024-09-11T00:45:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.451+0000 7fdcb9c00640 1 -- 172.21.15.81:0/40631106 wait complete. 2024-09-11T00:45:15.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.452+0000 7fdcb9c00640 1 Processor -- start 2024-09-11T00:45:15.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.453+0000 7fdcb9c00640 1 -- start start 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.453+0000 7fdcb9c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc98003a70 0x7fdcb40cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.453+0000 7fdcb9c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb41e35c0 0x7fdcb41f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb40c7040 con 0x7fdcb415a090 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb41581a0 con 0x7fdc98003a70 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb414efa0 con 0x7fdcb41e35c0 2024-09-11T00:45:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc98003a70 0x7fdcb40cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48266/0 (socket says 172.21.15.81:48266) 2024-09-11T00:45:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 -- 172.21.15.81:0/2544049210 learned_addr learned my addr 172.21.15.81:0/2544049210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb3400640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb41e35c0 0x7fdcb41f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 -- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb41e35c0 msgr2=0x7fdcb41f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb41e35c0 0x7fdcb41f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 -- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc98003a70 msgr2=0x7fdcb40cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc98003a70 0x7fdcb40cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.454+0000 7fdcb9200640 1 -- 172.21.15.81:0/2544049210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb415a820 con 0x7fdcb415a090 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcb9200640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb41527a0 tx=0x7fdcac006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00fab0 con 0x7fdcb415a090 2024-09-11T00:45:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcac00fc50 con 0x7fdcb415a090 2024-09-11T00:45:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb40c9bd0 con 0x7fdcb415a090 2024-09-11T00:45:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac011430 con 0x7fdcb415a090 2024-09-11T00:45:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.455+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb41e2e80 con 0x7fdcb415a090 2024-09-11T00:45:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.456+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb40c72b0 con 0x7fdcb415a090 2024-09-11T00:45:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.457+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdcac0115d0 con 0x7fdcb415a090 2024-09-11T00:45:15.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.458+0000 7fdcabe00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 0x7fdc9407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.458+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdcac09a8f0 con 0x7fdcb415a090 2024-09-11T00:45:15.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.459+0000 7fdcb3e00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 0x7fdc9407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.459+0000 7fdcb3e00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 0x7fdc9407a460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdca4035000 tx=0x7fdca402d040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.462+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdcac062990 con 0x7fdcb415a090 2024-09-11T00:45:15.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.736+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcb41f1ad0 con 0x7fdcb415a090 2024-09-11T00:45:15.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.737+0000 7fdcabe00640 1 -- 172.21.15.81:0/2544049210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fdcb41f1ad0 con 0x7fdcb415a090 2024-09-11T00:45:15.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:45:15.739 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:45:15.739 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 msgr2=0x7fdc9407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 0x7fdc9407a460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdca4035000 tx=0x7fdca402d040 comp rx=0 tx=0).stop 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 msgr2=0x7fdcb41498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb41527a0 tx=0x7fdcac006720 comp rx=0 tx=0).stop 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 shutdown_connections 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc94077fa0 0x7fdc9407a460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb415a090 0x7fdcb41498e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdcb41e35c0 0x7fdcb41f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 --2- 172.21.15.81:0/2544049210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc98003a70 0x7fdcb40cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.739+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 >> 172.21.15.81:0/2544049210 conn(0x7fdcb406ffd0 msgr2=0x7fdcb40c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.740+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 shutdown_connections 2024-09-11T00:45:15.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.740+0000 7fdcb9c00640 1 -- 172.21.15.81:0/2544049210 wait complete. 2024-09-11T00:45:15.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0' 2024-09-11T00:45:15.758 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0 2024-09-11T00:45:15.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.943+0000 7f7eb9a00640 1 -- 172.21.15.81:0/844078228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 msgr2=0x7f7eb406e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.943+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/844078228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb406e810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009830 tx=0x7f7ea402a640 comp rx=0 tx=0).stop 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.944+0000 7f7eb9a00640 1 -- 172.21.15.81:0/844078228 shutdown_connections 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.944+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/844078228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb406e810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.944+0000 7f7eb9a00640 1 -- 172.21.15.81:0/844078228 >> 172.21.15.81:0/844078228 conn(0x7f7eb40cbe00 msgr2=0x7f7eb40cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.944+0000 7f7eb9a00640 1 -- 172.21.15.81:0/844078228 shutdown_connections 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.944+0000 7f7eb9a00640 1 -- 172.21.15.81:0/844078228 wait complete. 2024-09-11T00:45:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.945+0000 7f7eb9a00640 1 Processor -- start 2024-09-11T00:45:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.945+0000 7f7eb9a00640 1 -- start start 2024-09-11T00:45:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7eb40c7420 0x7f7eb415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb406e010 con 0x7f7eb4070570 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40750b0 con 0x7f7eb414edb0 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.946+0000 7f7eb9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb406e2f0 con 0x7f7eb40c7420 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48270/0 (socket says 172.21.15.81:48270) 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 -- 172.21.15.81:0/2392499028 learned_addr learned my addr 172.21.15.81:0/2392499028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3400640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7eb40c7420 0x7f7eb415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb9000640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 -- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7eb40c7420 msgr2=0x7f7eb415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7eb40c7420 0x7f7eb415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 -- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 msgr2=0x7f7eb415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 -- 172.21.15.81:0/2392499028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb4159740 con 0x7f7eb4070570 2024-09-11T00:45:15.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb9000640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:45:15.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.947+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ea402ac30 tx=0x7f7ea4033df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.948+0000 7f7eabe00640 1 -- 172.21.15.81:0/2392499028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4005c90 con 0x7f7eb4070570 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.948+0000 7f7eabe00640 1 -- 172.21.15.81:0/2392499028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea40332e0 con 0x7f7eb4070570 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.948+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb4159cc0 con 0x7f7eb4070570 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.948+0000 7f7eabe00640 1 -- 172.21.15.81:0/2392499028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4005020 con 0x7f7eb4070570 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.948+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb40c59c0 con 0x7f7eb4070570 2024-09-11T00:45:15.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.950+0000 7f7eabe00640 1 -- 172.21.15.81:0/2392499028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ea40051c0 con 0x7f7eb4070570 2024-09-11T00:45:15.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.951+0000 7f7eabe00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 0x7f7e9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.951+0000 7f7eabe00640 1 -- 172.21.15.81:0/2392499028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7ea40baf50 con 0x7f7eb4070570 2024-09-11T00:45:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.952+0000 7f7eb3400640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 0x7f7e9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.952+0000 7f7eb3400640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 0x7f7e9407a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4159370 tx=0x7f7ea0009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.952+0000 7f7ebe086740 1 Processor -- start 2024-09-11T00:45:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 -- start start 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba46bd0 0x55715ba46fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba4dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55715b9bb260 con 0x55715ba8afb0 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55715b9aa690 con 0x55715ba46bd0 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.953+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55715b9ae4a0 con 0x55715ba4d4d0 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48282/0 (socket says 172.21.15.81:48282) 2024-09-11T00:45:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 -- 172.21.15.81:0/1723495418 learned_addr learned my addr 172.21.15.81:0/1723495418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba46bd0 0x55715ba46fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba4dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 -- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 msgr2=0x55715ba4dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba4dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 -- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba46bd0 msgr2=0x55715ba46fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba46bd0 0x55715ba46fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.954+0000 7f7eb9000640 1 -- 172.21.15.81:0/1723495418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715b784d80 con 0x55715ba8afb0 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.955+0000 7f7eb9000640 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001eb0 tx=0x7f7eac00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87046e37cbb09894 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.955+0000 7f7ea8c00640 1 -- 172.21.15.81:0/1723495418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac016020 con 0x55715ba8afb0 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.955+0000 7f7ea8c00640 1 -- 172.21.15.81:0/1723495418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eac0126e0 con 0x55715ba8afb0 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.955+0000 7f7ea8c00640 1 -- 172.21.15.81:0/1723495418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0020c0 con 0x55715ba8afb0 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 -- 172.21.15.81:0/1723495418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 msgr2=0x55715ba82120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001eb0 tx=0x7f7eac00d520 comp rx=0 tx=0).stop 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 -- 172.21.15.81:0/1723495418 shutdown_connections 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba8afb0 0x55715ba82120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba4dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1723495418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba46bd0 0x55715ba46fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 -- 172.21.15.81:0/1723495418 >> 172.21.15.81:0/1723495418 conn(0x55715ba48930 msgr2=0x55715ba4c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 -- 172.21.15.81:0/1723495418 shutdown_connections 2024-09-11T00:45:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.956+0000 7f7ebe086740 1 -- 172.21.15.81:0/1723495418 wait complete. 2024-09-11T00:45:15.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.957+0000 7f7ebe086740 1 -- start start 2024-09-11T00:45:15.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.957+0000 7f7ebe086740 1 Processor -- start 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715baa09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715ba740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55715b71acc0 con 0x55715ba75e60 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55715b94fe60 con 0x55715ba8afb0 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55715ba4c910 con 0x55715ba4d4d0 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.958+0000 7f7ebe086740 10 client.0 _ll_register_callbacks cb 0x55715b956030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715ba740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715baa09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715ba740c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:41158/0 (socket says 172.21.15.81:41158) 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb3400640 1 -- 172.21.15.81:0/757498022 learned_addr learned my addr 172.21.15.81:0/757498022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715baa09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:40932/0 (socket says 172.21.15.81:40932) 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 -- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 msgr2=0x55715baa09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715baa09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 -- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 msgr2=0x55715ba740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715ba740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 -- 172.21.15.81:0/757498022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715b7e5510 con 0x55715ba75e60 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.959+0000 7f7eb9000640 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba810a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7eac017000 tx=0x7f7eac003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28468f2fbfab5ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac016070 con 0x55715ba75e60 2024-09-11T00:45:15.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7eac00de40 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eac0126e0 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7eac029050 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7ebe086740 10 client.4881 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55715b6e9c20 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eac0126e0 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7eac02c020 con 0x55715ba75e60 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7ebe086740 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.960+0000 7f7ebe086740 10 client.4881 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.961+0000 7f7ebe086740 20 client.4881 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.961+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba815e0 0x55715ba7b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.961+0000 7f7ebe086740 4 client.4881 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:45:15.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.961+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55715b9bd1b0 con 0x55715ba815e0 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.961+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba815e0 0x55715ba7b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.962+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba815e0 0x55715ba7b590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c99fe2911941a15 server_cookie=eb4009e2c595866a in_seq=0 out_seq=0 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.962+0000 7f7e9d600640 10 client.4881 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7e9d600640 1 -- 172.21.15.81:0/757498022 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55715b9bd1b0 con 0x55715ba815e0 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7e9d600640 10 client.4881 handle_command_reply: tid=0 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 client.4881 shutdown 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 msgr2=0x55715ba810a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba810a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7eac017000 tx=0x7f7eac003f60 comp rx=0 tx=0).stop 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 shutdown_connections 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba815e0 0x55715ba7b590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba810a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715ba740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 --2- 172.21.15.81:0/757498022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715baa09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 >> 172.21.15.81:0/757498022 conn(0x55715ba46bd0 msgr2=0x55715ba41460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7e9d600640 0 client.4881 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 shutdown_connections 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 1 -- 172.21.15.81:0/757498022 wait complete. 2024-09-11T00:45:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.963+0000 7f7ebe086740 20 client.4881 trim_cache size 0 max 16384 2024-09-11T00:45:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.991+0000 7f7ebe086740 1 Processor -- start 2024-09-11T00:45:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.991+0000 7f7ebe086740 1 -- start start 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715bab17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715baa0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41faf40 con 0x55715ba75e60 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41f9e20 con 0x55715ba8afb0 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.992+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb40c2c10 con 0x55715ba4d4d0 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48300/0 (socket says 172.21.15.81:48300) 2024-09-11T00:45:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 -- 172.21.15.81:0/1521694900 learned_addr learned my addr 172.21.15.81:0/1521694900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:15.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb9000640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715baa0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715bab17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 -- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 msgr2=0x55715bab17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715bab17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 -- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 msgr2=0x55715baa0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715baa0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 -- 172.21.15.81:0/1521694900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715ba81410 con 0x55715ba75e60 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715bab17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.993+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e910 tx=0x7f7ea0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85245343931df020 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:15.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.994+0000 7f7e9fe00640 1 -- 172.21.15.81:0/1521694900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0027070 con 0x55715ba75e60 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.994+0000 7f7e9fe00640 1 -- 172.21.15.81:0/1521694900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea0015bc0 con 0x55715ba75e60 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.994+0000 7f7e9fe00640 1 -- 172.21.15.81:0/1521694900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0015db0 con 0x55715ba75e60 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- 172.21.15.81:0/1521694900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 msgr2=0x55715baa07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e910 tx=0x7f7ea0011000 comp rx=0 tx=0).stop 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- 172.21.15.81:0/1521694900 shutdown_connections 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715baa0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715baa07f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1521694900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715bab17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- 172.21.15.81:0/1521694900 >> 172.21.15.81:0/1521694900 conn(0x55715ba46bd0 msgr2=0x55715ba47ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- 172.21.15.81:0/1521694900 shutdown_connections 2024-09-11T00:45:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- 172.21.15.81:0/1521694900 wait complete. 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.995+0000 7f7ebe086740 1 -- start start 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.996+0000 7f7ebe086740 1 Processor -- start 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba79d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715bb11580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41f8a70 con 0x55715ba75e60 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41f9750 con 0x55715ba8afb0 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb41f90c0 con 0x55715ba4d4d0 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7ebe086740 10 client.0 _ll_register_callbacks cb 0x7f7ea402ab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:16.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48310/0 (socket says 172.21.15.81:48310) 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 -- 172.21.15.81:0/1901339772 learned_addr learned my addr 172.21.15.81:0/1901339772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb9000640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715bb11580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba79d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 -- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 msgr2=0x55715ba79d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba79d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 -- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 msgr2=0x55715bb11580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715bb11580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3400640 1 -- 172.21.15.81:0/1901339772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715ba8b9d0 con 0x55715ba75e60 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.997+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba79d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7eb3400640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e910 tx=0x7f7ea0013700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81c98eefa89dfd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7e9d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0031060 con 0x55715ba75e60 2024-09-11T00:45:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7ea0013dc0 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ea0015bc0 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7ea0037050 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7ebe086740 10 client.4887 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55715ba4bb50 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.998+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea0015bc0 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7ea0014070 con 0x55715ba75e60 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 10 client.4887 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 20 client.4887 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba8bf10 0x55715bb07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 4 client.4887 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}] 2024-09-11T00:45:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}) -- 0x55715b9b8c60 con 0x55715ba8bf10 2024-09-11T00:45:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:15.999+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba8bf10 0x55715bb07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.000+0000 7f7e9d600640 10 client.4887 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.000+0000 7f7eb3e00640 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba8bf10 0x55715bb07aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5e8cb25555caea server_cookie=b689e04cd1a505b0 in_seq=0 out_seq=0 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7e9d600640 1 -- 172.21.15.81:0/1901339772 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55715b9b8c60 con 0x55715ba8bf10 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7e9d600640 10 client.4887 handle_command_reply: tid=0 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 client.4887 shutdown 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 msgr2=0x55715ba8b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e910 tx=0x7f7ea0013700 comp rx=0 tx=0).stop 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 shutdown_connections 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55715ba8bf10 0x55715bb07aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55715ba8afb0 0x55715bb11580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55715ba75e60 0x55715ba8b490 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 --2- 172.21.15.81:0/1901339772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55715ba4d4d0 0x55715ba79d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7e9d600640 0 client.4887 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 >> 172.21.15.81:0/1901339772 conn(0x55715ba46bd0 msgr2=0x55715ba3db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 shutdown_connections 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.002+0000 7f7ebe086740 1 -- 172.21.15.81:0/1901339772 wait complete. 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7ebe086740 20 client.4887 trim_cache size 0 max 16384 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:45:16.005 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 2, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "f227b04e": { 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.2, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:45:16.006 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:16.007 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 msgr2=0x7f7e9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 0x7f7e9407a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4159370 tx=0x7f7ea0009040 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 msgr2=0x7f7eb41e41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ea402ac30 tx=0x7f7ea4033df0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 shutdown_connections 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.003+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e94077f70 0x7f7e9407a430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb414edb0 0x7f7eb415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7eb40c7420 0x7f7eb415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 --2- 172.21.15.81:0/2392499028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb4070570 0x7f7eb41e41f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 >> 172.21.15.81:0/2392499028 conn(0x7f7eb40cbe00 msgr2=0x7f7eb414a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:16.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 shutdown_connections 2024-09-11T00:45:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:16.004+0000 7f7eb9a00640 1 -- 172.21.15.81:0/2392499028 wait complete. 2024-09-11T00:45:16.022 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f227b04e', quiesce took 0.7 seconds. Will release after: 24.5 2024-09-11T00:45:40.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 -- 172.21.15.81:0/1162873074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 msgr2=0x7fdca006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 --2- 172.21.15.81:0/1162873074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca006d450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009830 tx=0x7fdc9002a4a0 comp rx=0 tx=0).stop 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 -- 172.21.15.81:0/1162873074 shutdown_connections 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 --2- 172.21.15.81:0/1162873074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 0x7fdca015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 --2- 172.21.15.81:0/1162873074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca006d450 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 -- 172.21.15.81:0/1162873074 >> 172.21.15.81:0/1162873074 conn(0x7fdca006ffd0 msgr2=0x7fdca00703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 -- 172.21.15.81:0/1162873074 shutdown_connections 2024-09-11T00:45:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.704+0000 7fdca5800640 1 -- 172.21.15.81:0/1162873074 wait complete. 2024-09-11T00:45:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.706+0000 7fdca5800640 1 Processor -- start 2024-09-11T00:45:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.706+0000 7fdca5800640 1 -- start start 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca00b1f10 0x7fdca00736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 0x7fdca00c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdca01581a0 con 0x7fdca014ebc0 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0159010 con 0x7fdca00b1f10 2024-09-11T00:45:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca5800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdca00c7040 con 0x7fdca015ba70 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdc9f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdc9f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54898/0 (socket says 172.21.15.81:54898) 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdc9f400640 1 -- 172.21.15.81:0/2139094289 learned_addr learned my addr 172.21.15.81:0/2139094289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdc9fe00640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca00b1f10 0x7fdca00736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.707+0000 7fdca4e00640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 0x7fdca00c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 -- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 msgr2=0x7fdca00c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 0x7fdca00c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 -- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca00b1f10 msgr2=0x7fdca00736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca00b1f10 0x7fdca00736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 -- 172.21.15.81:0/2139094289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca01f4b80 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc9f400640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c710 tx=0x7fdc8c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c016020 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.708+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc8c00a840 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.709+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca00c35b0 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.709+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ac70 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.709+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca00c3e70 con 0x7fdca014ebc0 2024-09-11T00:45:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.710+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca00c4070 con 0x7fdca014ebc0 2024-09-11T00:45:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.711+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdc8c01b400 con 0x7fdca014ebc0 2024-09-11T00:45:40.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.712+0000 7fdc97e00640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 0x7fdc8007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.712+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdc8c09a380 con 0x7fdca014ebc0 2024-09-11T00:45:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.713+0000 7fdc9fe00640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 0x7fdc8007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.713+0000 7fdc9fe00640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 0x7fdc8007a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc90034000 tx=0x7fdc90004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:40.717+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdca00c4070 con 0x7fdca014ebc0 2024-09-11T00:45:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.019+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdca015beb0 con 0x7fdca014ebc0 2024-09-11T00:45:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.020+0000 7fdc97e00640 1 -- 172.21.15.81:0/2139094289 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fdc8c020020 con 0x7fdca014ebc0 2024-09-11T00:45:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:45:41.023 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:45:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:45:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 msgr2=0x7fdc8007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 0x7fdc8007a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc90034000 tx=0x7fdc90004730 comp rx=0 tx=0).stop 2024-09-11T00:45:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 msgr2=0x7fdca00c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c710 tx=0x7fdc8c00cbd0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 shutdown_connections 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdc80077f70 0x7fdc8007a430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdca015ba70 0x7fdca00c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca014ebc0 0x7fdca00c4390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 --2- 172.21.15.81:0/2139094289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca00b1f10 0x7fdca00736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 >> 172.21.15.81:0/2139094289 conn(0x7fdca006ffd0 msgr2=0x7fdca01e3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 shutdown_connections 2024-09-11T00:45:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.023+0000 7fdca5800640 1 -- 172.21.15.81:0/2139094289 wait complete. 2024-09-11T00:45:41.042 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id f227b04e --release --await' 2024-09-11T00:45:41.042 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id f227b04e --release --await 2024-09-11T00:45:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.211+0000 7fdab7e00640 1 -- 172.21.15.81:0/1711646469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 msgr2=0x7fdab806cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.211+0000 7fdab7e00640 1 --2- 172.21.15.81:0/1711646469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab806cd90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4005fd0 tx=0x7fdaa402a660 comp rx=0 tx=0).stop 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 -- 172.21.15.81:0/1711646469 shutdown_connections 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 --2- 172.21.15.81:0/1711646469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab806cd90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 --2- 172.21.15.81:0/1711646469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 -- 172.21.15.81:0/1711646469 >> 172.21.15.81:0/1711646469 conn(0x7fdab806f730 msgr2=0x7fdab80688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 -- 172.21.15.81:0/1711646469 shutdown_connections 2024-09-11T00:45:41.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.212+0000 7fdab7e00640 1 -- 172.21.15.81:0/1711646469 wait complete. 2024-09-11T00:45:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.214+0000 7fdab7e00640 1 Processor -- start 2024-09-11T00:45:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.214+0000 7fdab7e00640 1 -- start start 2024-09-11T00:45:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.214+0000 7fdab7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 0x7fdab81f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.214+0000 7fdab7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815e160 con 0x7fdab80cada0 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815de80 con 0x7fdab806d2d0 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdab80cd410 con 0x7fdab81547f0 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 0x7fdab81f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54918/0 (socket says 172.21.15.81:54918) 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab6000640 1 -- 172.21.15.81:0/2489156934 learned_addr learned my addr 172.21.15.81:0/2489156934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:41.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.215+0000 7fdab7400640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 -- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 msgr2=0x7fdab814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 -- 172.21.15.81:0/2489156934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 msgr2=0x7fdab80cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 -- 172.21.15.81:0/2489156934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab80ce7e0 con 0x7fdab806d2d0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab7400640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6000640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 0x7fdab81f3de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c9a0 tx=0x7fdaa800ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdaaf400640 1 -- 172.21.15.81:0/2489156934 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8007bb0 con 0x7fdab806d2d0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdaaf400640 1 -- 172.21.15.81:0/2489156934 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa8007e40 con 0x7fdab806d2d0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdaaf400640 1 -- 172.21.15.81:0/2489156934 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800f690 con 0x7fdab806d2d0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.216+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab81f4780 con 0x7fdab806d2d0 2024-09-11T00:45:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.217+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab80c7570 con 0x7fdab806d2d0 2024-09-11T00:45:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.220+0000 7fdac0dbf740 1 Processor -- start 2024-09-11T00:45:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.220+0000 7fdaaf400640 1 -- 172.21.15.81:0/2489156934 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdaa800f830 con 0x7fdab806d2d0 2024-09-11T00:45:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.220+0000 7fdac0dbf740 1 -- start start 2024-09-11T00:45:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a38e370 0x560d8a38b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a38fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d8a303370 con 0x560d8a38e750 2024-09-11T00:45:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d8a2f27a0 con 0x560d8a38e370 2024-09-11T00:45:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560d8a2f65b0 con 0x560d8a3df0d0 2024-09-11T00:45:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdaaf400640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 0x7fda9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdaaf400640 1 -- 172.21.15.81:0/2489156934 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdaa809a630 con 0x7fdab806d2d0 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdab6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdab6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54930/0 (socket says 172.21.15.81:54930) 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.222+0000 7fdab6000640 1 -- 172.21.15.81:0/3185340448 learned_addr learned my addr 172.21.15.81:0/3185340448 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab7400640 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a38e370 0x560d8a38b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab7400640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 0x7fda9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 -- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 msgr2=0x560d8a38fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a38fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 -- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a38e370 msgr2=0x560d8a38b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a38e370 0x560d8a38b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 -- 172.21.15.81:0/3185340448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8a28b010 con 0x560d8a38e750 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab7400640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 0x7fda9807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdab0014bc0 tx=0x7fdab0001630 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.223+0000 7fdab6000640 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40099c0 tx=0x7fdaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9505ec1e1b8bff13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.224+0000 7fdaa3400640 1 -- 172.21.15.81:0/3185340448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4035040 con 0x560d8a38e750 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.224+0000 7fdaa3400640 1 -- 172.21.15.81:0/3185340448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa4005310 con 0x560d8a38e750 2024-09-11T00:45:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.224+0000 7fdaa3400640 1 -- 172.21.15.81:0/3185340448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4003820 con 0x560d8a38e750 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 -- 172.21.15.81:0/3185340448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 msgr2=0x560d8a3c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40099c0 tx=0x7fdaa40046c0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 -- 172.21.15.81:0/3185340448 shutdown_connections 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3c6540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a38fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/3185340448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a38e370 0x560d8a38b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 -- 172.21.15.81:0/3185340448 >> 172.21.15.81:0/3185340448 conn(0x560d8a38c550 msgr2=0x560d8a38da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 -- 172.21.15.81:0/3185340448 shutdown_connections 2024-09-11T00:45:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.225+0000 7fdac0dbf740 1 -- 172.21.15.81:0/3185340448 wait complete. 2024-09-11T00:45:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.226+0000 7fdac0dbf740 1 -- start start 2024-09-11T00:45:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.226+0000 7fdac0dbf740 1 Processor -- start 2024-09-11T00:45:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a38e750 0x560d8a3ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3bf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560d8a299f70 con 0x560d8a3c22c0 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d8a298090 con 0x560d8a3df0d0 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560d8a3ecfe0 con 0x560d8a38e750 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdac0dbf740 10 client.0 _ll_register_callbacks cb 0x560d8a001110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdab7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdab7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54946/0 (socket says 172.21.15.81:54946) 2024-09-11T00:45:41.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.227+0000 7fdab7400640 1 -- 172.21.15.81:0/478189264 learned_addr learned my addr 172.21.15.81:0/478189264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:41.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab6000640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3bf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab6a00640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a38e750 0x560d8a3ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 -- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a38e750 msgr2=0x560d8a3ec5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a38e750 0x560d8a3ec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 -- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 msgr2=0x560d8a3bf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3bf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 -- 172.21.15.81:0/478189264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d8a054ea0 con 0x560d8a3c22c0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab6000640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3bf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fdab7400640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdab00149b0 tx=0x7fdab0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fa2d8d01a0a6e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fda97e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0010040 con 0x560d8a3c22c0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.228+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdab0005610 con 0x560d8a3c22c0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa4005310 con 0x560d8a3c22c0 2024-09-11T00:45:41.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdab002d050 con 0x560d8a3c22c0 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 10 client.4911 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560d8a0cdd30 con 0x560d8a3c22c0 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa4005310 con 0x560d8a3c22c0 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdab0030020 con 0x560d8a3c22c0 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 10 client.4911 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 10 client.4911 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 20 client.4911 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a3b94f0 0x560d8a3bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 4 client.4911 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.229+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d8a3052c0 con 0x560d8a3b94f0 2024-09-11T00:45:41.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.230+0000 7fdab6a00640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a3b94f0 0x560d8a3bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.231+0000 7fdab6a00640 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a3b94f0 0x560d8a3bbec0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba08931f29c6719f server_cookie=2169e8835a98e470 in_seq=0 out_seq=0 2024-09-11T00:45:41.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.231+0000 7fda97e00640 10 client.4911 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:41.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.231+0000 7fda97e00640 1 -- 172.21.15.81:0/478189264 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d8a3052c0 con 0x560d8a3b94f0 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.231+0000 7fda97e00640 10 client.4911 handle_command_reply: tid=0 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 client.4911 shutdown 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 msgr2=0x560d8a3b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdab00149b0 tx=0x7fdab0001250 comp rx=0 tx=0).stop 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 shutdown_connections 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a3b94f0 0x560d8a3bbec0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a3c22c0 0x560d8a3b8fb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3bf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/478189264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a38e750 0x560d8a3ec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 >> 172.21.15.81:0/478189264 conn(0x560d8a38e370 msgr2=0x560d8a390500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fda97e00640 0 client.4911 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:41.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 shutdown_connections 2024-09-11T00:45:41.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.232+0000 7fdac0dbf740 1 -- 172.21.15.81:0/478189264 wait complete. 2024-09-11T00:45:41.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.233+0000 7fdac0dbf740 20 client.4911 trim_cache size 0 max 16384 2024-09-11T00:45:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.267+0000 7fdac0dbf740 1 Processor -- start 2024-09-11T00:45:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.267+0000 7fdac0dbf740 1 -- start start 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3c22c0 0x560d8a3fc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdab81faf50 con 0x560d8a38e750 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdab80730a0 con 0x560d8a3df0d0 2024-09-11T00:45:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.268+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdab81f1500 con 0x560d8a3c22c0 2024-09-11T00:45:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54948/0 (socket says 172.21.15.81:54948) 2024-09-11T00:45:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 -- 172.21.15.81:0/2446672112 learned_addr learned my addr 172.21.15.81:0/2446672112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab7400640 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6000640 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3c22c0 0x560d8a3fc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 -- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3c22c0 msgr2=0x560d8a3fc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3c22c0 0x560d8a3fc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 -- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 msgr2=0x560d8a3fcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3fcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.269+0000 7fdab6a00640 1 -- 172.21.15.81:0/2446672112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8a38a810 con 0x560d8a38e750 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.270+0000 7fdab6a00640 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8062460 tx=0x7fdaa800a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6190054966578e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.270+0000 7fdaa2a00640 1 -- 172.21.15.81:0/2446672112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801d040 con 0x560d8a38e750 2024-09-11T00:45:41.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.270+0000 7fdaa2a00640 1 -- 172.21.15.81:0/2446672112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa805e9d0 con 0x560d8a38e750 2024-09-11T00:45:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.270+0000 7fdaa2a00640 1 -- 172.21.15.81:0/2446672112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8088440 con 0x560d8a38e750 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 -- 172.21.15.81:0/2446672112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 msgr2=0x560d8a38d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8062460 tx=0x7fdaa800a300 comp rx=0 tx=0).stop 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 -- 172.21.15.81:0/2446672112 shutdown_connections 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3df0d0 0x560d8a3fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3c22c0 0x560d8a3fc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/2446672112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a38d750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 -- 172.21.15.81:0/2446672112 >> 172.21.15.81:0/2446672112 conn(0x560d8a38e370 msgr2=0x560d8a391050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 -- 172.21.15.81:0/2446672112 shutdown_connections 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.271+0000 7fdac0dbf740 1 -- 172.21.15.81:0/2446672112 wait complete. 2024-09-11T00:45:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.272+0000 7fdac0dbf740 1 -- start start 2024-09-11T00:45:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.272+0000 7fdac0dbf740 1 Processor -- start 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3c22c0 0x560d8a45d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a45dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8071cf0 con 0x560d8a38e750 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdab80729d0 con 0x560d8a3c22c0 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdab8072340 con 0x560d8a3df0d0 2024-09-11T00:45:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdac0dbf740 10 client.0 _ll_register_callbacks cb 0x7fdab0004d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdab6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdab6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54954/0 (socket says 172.21.15.81:54954) 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdab6a00640 1 -- 172.21.15.81:0/4160339833 learned_addr learned my addr 172.21.15.81:0/4160339833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.273+0000 7fdab7400640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a45dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6000640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3c22c0 0x560d8a45d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 -- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 msgr2=0x560d8a45dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a45dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 -- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3c22c0 msgr2=0x560d8a45d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3c22c0 0x560d8a45d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 -- 172.21.15.81:0/4160339833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d8a3ddc90 con 0x560d8a38e750 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdab6a00640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80987b0 tx=0x7fdaa806bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142828a5e0690850 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:45:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fda97e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801d040 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdaa80883e0 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.274+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa805e9d0 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.275+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdaa806b720 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.275+0000 7fdac0dbf740 10 client.4917 fetch_fsmap learned FSMap version 9 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.275+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560d8a3c53d0 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.275+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa805e9d0 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.275+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdaa8098b70 con 0x560d8a38e750 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 10 client.4917 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 10 client.4917 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 20 client.4917 populate_metadata read hostname 'smithi081' 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a45ab60 0x560d8a45e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:45:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 4 client.4917 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f227b04e", "release": true, "await": true}] 2024-09-11T00:45:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f227b04e", "release": true, "await": true}) -- 0x560d8a300d70 con 0x560d8a45ab60 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.276+0000 7fdab6000640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a45ab60 0x560d8a45e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.277+0000 7fda97e00640 10 client.4917 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.277+0000 7fdab6000640 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a45ab60 0x560d8a45e150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d938732cad44c150 server_cookie=4a9a28cdf37288ab in_seq=0 out_seq=0 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fda97e00640 1 -- 172.21.15.81:0/4160339833 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x560d8a300d70 con 0x560d8a45ab60 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fda97e00640 10 client.4917 handle_command_reply: tid=0 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 client.4917 shutdown 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 msgr2=0x560d8a3fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80987b0 tx=0x7fdaa806bd10 comp rx=0 tx=0).stop 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 shutdown_connections 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560d8a45ab60 0x560d8a45e150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560d8a3df0d0 0x560d8a45dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d8a3c22c0 0x560d8a45d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 --2- 172.21.15.81:0/4160339833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560d8a38e750 0x560d8a3fc9a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 >> 172.21.15.81:0/4160339833 conn(0x560d8a38e370 msgr2=0x560d8a38d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fda97e00640 0 client.4917 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 shutdown_connections 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.278+0000 7fdac0dbf740 1 -- 172.21.15.81:0/4160339833 wait complete. 2024-09-11T00:45:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdac0dbf740 20 client.4917 trim_cache size 0 max 16384 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 4, 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "f227b04e": { 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4, 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:45:41.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.2, 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:41.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 msgr2=0x7fda9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 0x7fda9807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdab0014bc0 tx=0x7fdab0001630 comp rx=0 tx=0).stop 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 msgr2=0x7fdab81f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 0x7fdab81f3de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c9a0 tx=0x7fdaa800ce60 comp rx=0 tx=0).stop 2024-09-11T00:45:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 shutdown_connections 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fda98077f70 0x7fda9807a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdab81547f0 0x7fdab814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab80cada0 0x7fdab80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 --2- 172.21.15.81:0/2489156934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab806d2d0 0x7fdab81f3de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.279+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 >> 172.21.15.81:0/2489156934 conn(0x7fdab806f730 msgr2=0x7fdab80c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.280+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 shutdown_connections 2024-09-11T00:45:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:45:41.280+0000 7fdab7e00640 1 -- 172.21.15.81:0/2489156934 wait complete. 2024-09-11T00:45:41.303 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f227b04e', total seconds elapsed: 26.0 2024-09-11T00:45:41.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:41.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:45:56.467 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 67% (8139/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T00:45:57.631 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T00:45:57.632 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.632 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T00:45:57.632 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T00:45:57.632 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T00:45:57.632 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-09-11T00:45:57.633 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.634 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T00:45:57.634 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-11T00:45:57.634 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:45:57.643 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T00:45:57.691 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T00:45:57.696 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:45:57.696 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T00:45:58.294 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T00:45:58.389 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T00:45:58.454 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:45:58.458 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:45:58.458 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T00:45:58.522 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:45:58.529 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T00:45:58.529 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T00:45:58.565 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-11T00:45:58.566 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-11T00:45:58.566 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T00:45:58.666 INFO:tasks.workunit.client.0.smithi081.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T00:45:58.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-11T00:45:58.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ trap -- retry EXIT 2024-09-11T00:45:58.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf ffsb 2024-09-11T00:45:58.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-11T00:45:58.679 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into 'ffsb'... 2024-09-11T00:46:01.139 INFO:tasks.workunit.client.0.smithi081.stderr:+ trap - EXIT 2024-09-11T00:46:01.139 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ffsb 2024-09-11T00:46:01.140 INFO:tasks.workunit.client.0.smithi081.stderr:+ ./configure 2024-09-11T00:46:01.406 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T00:46:02.424 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether build environment is sane... yes 2024-09-11T00:46:02.455 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T00:46:02.456 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gawk... gawk 2024-09-11T00:46:02.492 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T00:46:02.585 INFO:tasks.workunit.client.0.smithi081.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T00:46:02.585 INFO:tasks.workunit.client.0.smithi081.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T00:46:02.613 INFO:tasks.workunit.client.0.smithi081.stdout:checking for style of include used by make... GNU 2024-09-11T00:46:02.621 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... gcc 2024-09-11T00:46:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:checking for C compiler default output file name... a.out 2024-09-11T00:46:02.771 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the C compiler works... yes 2024-09-11T00:46:02.777 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are cross compiling... no 2024-09-11T00:46:02.866 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of executables... 2024-09-11T00:46:02.942 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of object files... o 2024-09-11T00:46:03.019 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T00:46:03.097 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... yes 2024-09-11T00:46:03.200 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T00:46:03.429 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... gcc3 2024-09-11T00:46:03.550 INFO:tasks.workunit.client.0.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T00:46:03.663 INFO:tasks.workunit.client.0.smithi081.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T00:46:03.666 INFO:tasks.workunit.client.0.smithi081.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T00:46:03.694 INFO:tasks.workunit.client.0.smithi081.stdout:checking for AIX... no 2024-09-11T00:46:03.721 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... (cached) gcc 2024-09-11T00:46:03.748 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T00:46:03.750 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T00:46:03.751 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T00:46:03.751 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T00:46:03.887 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lm... yes 2024-09-11T00:46:04.012 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lpthread... yes 2024-09-11T00:46:04.341 INFO:tasks.workunit.client.0.smithi081.stdout:checking for ANSI C header files... yes 2024-09-11T00:46:04.470 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T00:46:04.571 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/types.h... yes 2024-09-11T00:46:04.683 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/stat.h... yes 2024-09-11T00:46:04.794 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdlib.h... yes 2024-09-11T00:46:04.912 INFO:tasks.workunit.client.0.smithi081.stdout:checking for string.h... yes 2024-09-11T00:46:05.027 INFO:tasks.workunit.client.0.smithi081.stdout:checking for memory.h... yes 2024-09-11T00:46:05.140 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strings.h... yes 2024-09-11T00:46:05.254 INFO:tasks.workunit.client.0.smithi081.stdout:checking for inttypes.h... yes 2024-09-11T00:46:05.369 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... yes 2024-09-11T00:46:05.503 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... yes 2024-09-11T00:46:05.641 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h usability... yes 2024-09-11T00:46:05.695 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h presence... yes 2024-09-11T00:46:05.696 INFO:tasks.workunit.client.0.smithi081.stdout:checking for pthread.h... yes 2024-09-11T00:46:05.814 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h usability... yes 2024-09-11T00:46:05.865 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h presence... yes 2024-09-11T00:46:05.866 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fcntl.h... yes 2024-09-11T00:46:05.989 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h usability... yes 2024-09-11T00:46:06.042 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h presence... yes 2024-09-11T00:46:06.043 INFO:tasks.workunit.client.0.smithi081.stdout:checking for limits.h... yes 2024-09-11T00:46:06.092 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... (cached) yes 2024-09-11T00:46:06.198 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h usability... yes 2024-09-11T00:46:06.248 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h presence... yes 2024-09-11T00:46:06.250 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/time.h... yes 2024-09-11T00:46:06.285 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... (cached) yes 2024-09-11T00:46:06.402 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h usability... yes 2024-09-11T00:46:06.453 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h presence... yes 2024-09-11T00:46:06.455 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/vfs.h... yes 2024-09-11T00:46:06.580 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h usability... no 2024-09-11T00:46:06.639 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h presence... no 2024-09-11T00:46:06.640 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/limits.h... no 2024-09-11T00:46:06.721 INFO:tasks.workunit.client.0.smithi081.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T00:46:06.802 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T00:46:06.806 INFO:tasks.workunit.client.0.smithi081.stdout:checking for function prototypes... yes 2024-09-11T00:46:06.899 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether setvbuf arguments are reversed... no 2024-09-11T00:46:07.061 INFO:tasks.workunit.client.0.smithi081.stdout:checking for system... yes 2024-09-11T00:46:07.208 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gettimeofday... yes 2024-09-11T00:46:07.362 INFO:tasks.workunit.client.0.smithi081.stdout:checking for mkdir... yes 2024-09-11T00:46:07.535 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strerror... yes 2024-09-11T00:46:07.685 INFO:tasks.workunit.client.0.smithi081.stdout:checking for open64... yes 2024-09-11T00:46:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stat64... yes 2024-09-11T00:46:07.987 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fseeko64... yes 2024-09-11T00:46:08.139 INFO:tasks.workunit.client.0.smithi081.stdout:checking for lrand48_r... yes 2024-09-11T00:46:08.288 INFO:tasks.workunit.client.0.smithi081.stdout:checking for srand48_r... yes 2024-09-11T00:46:08.338 INFO:tasks.workunit.client.0.smithi081.stdout:configure: creating ./config.status 2024-09-11T00:46:08.628 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating Makefile 2024-09-11T00:46:08.666 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-09-11T00:46:08.715 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing depfiles commands 2024-09-11T00:46:08.862 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing default commands 2024-09-11T00:46:08.956 INFO:tasks.workunit.client.0.smithi081.stderr:+ make 2024-09-11T00:46:09.000 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-11T00:46:09.014 INFO:tasks.workunit.client.0.smithi081.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-11T00:46:09.017 INFO:tasks.workunit.client.0.smithi081.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-11T00:46:09.017 INFO:tasks.workunit.client.0.smithi081.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-11T00:46:09.017 INFO:tasks.workunit.client.0.smithi081.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-11T00:46:09.017 INFO:tasks.workunit.client.0.smithi081.stderr: any GNU archive site. 2024-09-11T00:46:09.025 INFO:tasks.workunit.client.0.smithi081.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-11T00:46:09.034 INFO:tasks.workunit.client.0.smithi081.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-11T00:46:09.036 INFO:tasks.workunit.client.0.smithi081.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-11T00:46:09.036 INFO:tasks.workunit.client.0.smithi081.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-11T00:46:09.036 INFO:tasks.workunit.client.0.smithi081.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-11T00:46:09.036 INFO:tasks.workunit.client.0.smithi081.stderr: Grab them from any GNU archive site. 2024-09-11T00:46:09.303 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-11T00:46:09.738 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-11T00:46:09.738 INFO:tasks.workunit.client.0.smithi081.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-11T00:46:09.738 INFO:tasks.workunit.client.0.smithi081.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-11T00:46:09.738 INFO:tasks.workunit.client.0.smithi081.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-11T00:46:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:/bin/sh ./config.status --recheck 2024-09-11T00:46:10.044 INFO:tasks.workunit.client.0.smithi081.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-11T00:46:10.325 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T00:46:11.342 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether build environment is sane... yes 2024-09-11T00:46:11.362 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T00:46:11.363 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gawk... gawk 2024-09-11T00:46:11.395 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T00:46:11.491 INFO:tasks.workunit.client.0.smithi081.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T00:46:11.492 INFO:tasks.workunit.client.0.smithi081.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T00:46:11.518 INFO:tasks.workunit.client.0.smithi081.stdout:checking for style of include used by make... GNU 2024-09-11T00:46:11.526 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... gcc 2024-09-11T00:46:11.724 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the C compiler works... yes 2024-09-11T00:46:11.724 INFO:tasks.workunit.client.0.smithi081.stdout:checking for C compiler default output file name... a.out 2024-09-11T00:46:11.812 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of executables... 2024-09-11T00:46:11.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:11.869 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:11.912 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are cross compiling... no 2024-09-11T00:46:11.989 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of object files... o 2024-09-11T00:46:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T00:46:12.102 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... yes 2024-09-11T00:46:12.176 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T00:46:12.399 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... gcc3 2024-09-11T00:46:12.505 INFO:tasks.workunit.client.0.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T00:46:12.607 INFO:tasks.workunit.client.0.smithi081.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T00:46:12.611 INFO:tasks.workunit.client.0.smithi081.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T00:46:12.876 INFO:tasks.workunit.client.0.smithi081.stdout:checking for ANSI C header files... yes 2024-09-11T00:46:12.953 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/types.h... yes 2024-09-11T00:46:13.039 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/stat.h... yes 2024-09-11T00:46:13.129 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdlib.h... yes 2024-09-11T00:46:13.217 INFO:tasks.workunit.client.0.smithi081.stdout:checking for string.h... yes 2024-09-11T00:46:13.306 INFO:tasks.workunit.client.0.smithi081.stdout:checking for memory.h... yes 2024-09-11T00:46:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strings.h... yes 2024-09-11T00:46:13.495 INFO:tasks.workunit.client.0.smithi081.stdout:checking for inttypes.h... yes 2024-09-11T00:46:13.587 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... yes 2024-09-11T00:46:13.678 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... yes 2024-09-11T00:46:13.772 INFO:tasks.workunit.client.0.smithi081.stdout:checking minix/config.h usability... no 2024-09-11T00:46:13.834 INFO:tasks.workunit.client.0.smithi081.stdout:checking minix/config.h presence... no 2024-09-11T00:46:13.834 INFO:tasks.workunit.client.0.smithi081.stdout:checking for minix/config.h... no 2024-09-11T00:46:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-11T00:46:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... (cached) gcc 2024-09-11T00:46:14.003 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T00:46:14.003 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T00:46:14.004 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T00:46:14.005 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T00:46:14.110 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lm... yes 2024-09-11T00:46:14.218 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lpthread... yes 2024-09-11T00:46:14.225 INFO:tasks.workunit.client.0.smithi081.stdout:checking for ANSI C header files... (cached) yes 2024-09-11T00:46:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T00:46:14.385 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h usability... yes 2024-09-11T00:46:14.426 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h presence... yes 2024-09-11T00:46:14.426 INFO:tasks.workunit.client.0.smithi081.stdout:checking for pthread.h... yes 2024-09-11T00:46:14.544 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h usability... yes 2024-09-11T00:46:14.581 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h presence... yes 2024-09-11T00:46:14.582 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fcntl.h... yes 2024-09-11T00:46:14.699 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h usability... yes 2024-09-11T00:46:14.735 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h presence... yes 2024-09-11T00:46:14.736 INFO:tasks.workunit.client.0.smithi081.stdout:checking for limits.h... yes 2024-09-11T00:46:14.764 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... (cached) yes 2024-09-11T00:46:14.855 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h usability... yes 2024-09-11T00:46:14.893 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h presence... yes 2024-09-11T00:46:14.894 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/time.h... yes 2024-09-11T00:46:14.926 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... (cached) yes 2024-09-11T00:46:15.017 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h usability... yes 2024-09-11T00:46:15.057 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h presence... yes 2024-09-11T00:46:15.057 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/vfs.h... yes 2024-09-11T00:46:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h usability... no 2024-09-11T00:46:15.229 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h presence... no 2024-09-11T00:46:15.229 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/limits.h... no 2024-09-11T00:46:15.289 INFO:tasks.workunit.client.0.smithi081.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T00:46:15.355 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T00:46:15.506 INFO:tasks.workunit.client.0.smithi081.stdout:checking for system... yes 2024-09-11T00:46:15.637 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gettimeofday... yes 2024-09-11T00:46:15.772 INFO:tasks.workunit.client.0.smithi081.stdout:checking for mkdir... yes 2024-09-11T00:46:15.908 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strerror... yes 2024-09-11T00:46:16.040 INFO:tasks.workunit.client.0.smithi081.stdout:checking for open64... yes 2024-09-11T00:46:16.170 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stat64... yes 2024-09-11T00:46:16.302 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fseeko64... yes 2024-09-11T00:46:16.436 INFO:tasks.workunit.client.0.smithi081.stdout:checking for lrand48_r... yes 2024-09-11T00:46:16.579 INFO:tasks.workunit.client.0.smithi081.stdout:checking for srand48_r... yes 2024-09-11T00:46:16.623 INFO:tasks.workunit.client.0.smithi081.stdout:configure: creating ./config.status 2024-09-11T00:46:16.814 INFO:tasks.workunit.client.0.smithi081.stdout: /bin/sh ./config.status 2024-09-11T00:46:16.937 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating Makefile 2024-09-11T00:46:16.970 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-09-11T00:46:17.013 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing depfiles commands 2024-09-11T00:46:17.057 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing default commands 2024-09-11T00:46:17.131 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-11T00:46:17.375 INFO:tasks.workunit.client.0.smithi081.stdout:rm -f stamp-h1 2024-09-11T00:46:17.379 INFO:tasks.workunit.client.0.smithi081.stdout:touch config.h.in 2024-09-11T00:46:17.383 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/sh ./config.status config.h 2024-09-11T00:46:17.488 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-09-11T00:46:17.560 INFO:tasks.workunit.client.0.smithi081.stdout:make all-am 2024-09-11T00:46:17.603 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T00:46:17.603 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-11T00:46:17.858 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-11T00:46:17.865 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-11T00:46:18.021 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-11T00:46:18.029 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-11T00:46:18.191 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-11T00:46:18.199 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-11T00:46:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-11T00:46:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-11T00:46:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-11T00:46:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-11T00:46:18.690 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-11T00:46:18.698 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-11T00:46:18.783 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-11T00:46:18.792 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-11T00:46:18.888 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-11T00:46:18.897 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-11T00:46:19.157 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-11T00:46:19.165 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-11T00:46:19.362 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-11T00:46:19.370 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-11T00:46:19.603 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-11T00:46:19.611 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-11T00:46:19.742 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-11T00:46:19.751 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-11T00:46:20.033 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-11T00:46:20.042 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-11T00:46:20.862 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-11T00:46:20.872 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-11T00:46:20.952 INFO:tasks.workunit.client.0.smithi081.stderr:In file included from parser.h:22, 2024-09-11T00:46:20.952 INFO:tasks.workunit.client.0.smithi081.stderr: from parser.c:25: 2024-09-11T00:46:20.952 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function ‘init_filesys’: 2024-09-11T00:46:20.954 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.954 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.954 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.954 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.955 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.956 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.957 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T00:46:20.958 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.959 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-11T00:46:20.959 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.959 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.959 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.959 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.960 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.961 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:20.962 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T00:46:20.963 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function ‘get_optstr’: 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:200:14: note: source object declared here 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr: 200 | char temp[BUFSIZE]; 2024-09-11T00:46:21.054 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~ 2024-09-11T00:46:21.066 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function ‘size64_convert’: 2024-09-11T00:46:21.066 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-11T00:46:21.067 INFO:tasks.workunit.client.0.smithi081.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-11T00:46:21.067 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-11T00:46:21.425 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-11T00:46:21.434 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-11T00:46:21.552 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-11T00:46:21.561 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-11T00:46:21.708 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-11T00:46:21.717 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-11T00:46:21.784 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-11T00:46:21.794 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-11T00:46:21.984 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T00:46:21.985 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .. 2024-09-11T00:46:21.988 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir tmp 2024-09-11T00:46:21.992 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd tmp 2024-09-11T00:46:21.994 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in $mydir/*.ffsb 2024-09-11T00:46:21.995 INFO:tasks.workunit.client.0.smithi081.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-11T00:46:21.997 INFO:tasks.workunit.client.0.smithi081.stdout:FFSB version 6.0-RC2 started 2024-09-11T00:46:21.997 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout:benchmark time = 300 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout:ThreadGroup 0 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout:================ 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: num_threads = 32 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: read_random = off 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: read_size = 0 (0B) 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: read_blocksize = 0 (0B) 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: read_skip = off 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: read_skipsize = 0 (0B) 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: write_random = on 2024-09-11T00:46:22.003 INFO:tasks.workunit.client.0.smithi081.stdout: write_size = 5242880 (5MB) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: fsync_file = 0 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: write_blocksize = 4096 (4KB) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: wait time = 0 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: op weights 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: read = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: readall = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: write = 1 (100.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: create = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: append = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: delete = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: metaop = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: createdir = 0 (0.00%) 2024-09-11T00:46:22.004 INFO:tasks.workunit.client.0.smithi081.stdout: stat = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: writeall = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: writeall_fsync = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: open_close = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: write_fsync = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: create_fsync = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: append_fsync = 0 (0.00%) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout:FileSystem . 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout:========== 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: num_dirs = 0 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: starting files = 128 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: min file size = 104857600 (100MB) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: max file size = 104857600 (100MB) 2024-09-11T00:46:22.005 INFO:tasks.workunit.client.0.smithi081.stdout: directio = off 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: alignedio = on 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: bufferedio = off 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: aging is off 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: current utilization = 0.03% 2024-09-11T00:46:22.006 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T00:46:22.007 INFO:tasks.workunit.client.0.smithi081.stdout:checking existing fs: . 2024-09-11T00:46:22.007 INFO:tasks.workunit.client.0.smithi081.stdout:recreating new fileset 2024-09-11T00:46:22.007 INFO:tasks.workunit.client.0.smithi081.stderr:opendir: No such file or directory 2024-09-11T00:46:28.104 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:46:28.104 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-11T00:46:28.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 -- 172.21.15.81:0/1874538367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 msgr2=0x7fa4bc072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 --2- 172.21.15.81:0/1874538367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc072d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0b1740 tx=0x7fa4b402a560 comp rx=0 tx=0).stop 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 -- 172.21.15.81:0/1874538367 shutdown_connections 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 --2- 172.21.15.81:0/1874538367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 --2- 172.21.15.81:0/1874538367 >> v2:172.21.15.167:3300/0 conn(0x7fa4bc157150 0x7fa4bc0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 --2- 172.21.15.81:0/1874538367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc072d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 -- 172.21.15.81:0/1874538367 >> 172.21.15.81:0/1874538367 conn(0x7fa4bc06ffd0 msgr2=0x7fa4bc0703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 -- 172.21.15.81:0/1874538367 shutdown_connections 2024-09-11T00:46:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.278+0000 7fa4c2000640 1 -- 172.21.15.81:0/1874538367 wait complete. 2024-09-11T00:46:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.280+0000 7fa4c2000640 1 Processor -- start 2024-09-11T00:46:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.280+0000 7fa4c2000640 1 -- start start 2024-09-11T00:46:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4bc157150 0x7fa4bc152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc072510 con 0x7fa4bc151250 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc074ee0 con 0x7fa4bc157150 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.281+0000 7fa4c2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc0727f0 con 0x7fa4bc0c7ff0 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4c0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4c0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33428/0 (socket says 172.21.15.81:33428) 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4c0c00640 1 -- 172.21.15.81:0/923217413 learned_addr learned my addr 172.21.15.81:0/923217413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4c1600640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4bc157150 0x7fa4bc152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 -- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 msgr2=0x7fa4bc153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 -- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4bc157150 msgr2=0x7fa4bc152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4bc157150 0x7fa4bc152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4bbe00640 1 -- 172.21.15.81:0/923217413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc163560 con 0x7fa4bc151250 2024-09-11T00:46:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.282+0000 7fa4c0c00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:46:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4bbe00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc14f4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400d660 tx=0x7fa4a400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4017070 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4a4004310 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc1629e0 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4005260 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.283+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc162fa0 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.284+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc0b2140 con 0x7fa4bc151250 2024-09-11T00:46:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.285+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa4a4005400 con 0x7fa4bc151250 2024-09-11T00:46:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.286+0000 7fa4b8c00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 0x7fa49807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.286+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa4a409a280 con 0x7fa4bc151250 2024-09-11T00:46:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.287+0000 7fa4c0c00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 0x7fa49807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.287+0000 7fa4c0c00640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 0x7fa49807a460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40096c0 tx=0x7fa4b4004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.291+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa4a4020020 con 0x7fa4bc151250 2024-09-11T00:46:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.569+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4bc0c1a30 con 0x7fa4bc151250 2024-09-11T00:46:28.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.570+0000 7fa4b8c00640 1 -- 172.21.15.81:0/923217413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fa4a406b130 con 0x7fa4bc151250 2024-09-11T00:46:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:46:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:46:28.573 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:46:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.573+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 msgr2=0x7fa49807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.573+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 0x7fa49807a460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40096c0 tx=0x7fa4b4004730 comp rx=0 tx=0).stop 2024-09-11T00:46:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.573+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 msgr2=0x7fa4bc14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.573+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc14f4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400d660 tx=0x7fa4a400db20 comp rx=0 tx=0).stop 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 shutdown_connections 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa498077fa0 0x7fa49807a460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4bc157150 0x7fa4bc152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc151250 0x7fa4bc14f4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 --2- 172.21.15.81:0/923217413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4bc0c7ff0 0x7fa4bc153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 >> 172.21.15.81:0/923217413 conn(0x7fa4bc06ffd0 msgr2=0x7fa4bc155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.574+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 shutdown_connections 2024-09-11T00:46:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.575+0000 7fa4c2000640 1 -- 172.21.15.81:0/923217413 wait complete. 2024-09-11T00:46:28.596 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-11T00:46:28.596 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-11T00:46:28.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 -- 172.21.15.81:0/2913371127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe624154810 msgr2=0x7fe6240cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 --2- 172.21.15.81:0/2913371127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe624154810 0x7fe6240cadf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe614005fd0 tx=0x7fe61402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 -- 172.21.15.81:0/2913371127 shutdown_connections 2024-09-11T00:46:28.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 --2- 172.21.15.81:0/2913371127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240cc030 0x7fe6240cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 --2- 172.21.15.81:0/2913371127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe624154810 0x7fe6240cadf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.773+0000 7fe623200640 1 -- 172.21.15.81:0/2913371127 >> 172.21.15.81:0/2913371127 conn(0x7fe6240688e0 msgr2=0x7fe624068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.774+0000 7fe623200640 1 -- 172.21.15.81:0/2913371127 shutdown_connections 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.774+0000 7fe623200640 1 -- 172.21.15.81:0/2913371127 wait complete. 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.775+0000 7fe623200640 1 Processor -- start 2024-09-11T00:46:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.775+0000 7fe623200640 1 -- start start 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240c4f60 0x7fe624153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe624154810 0x7fe62414b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415a500 con 0x7fe6240cc030 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415b0b0 con 0x7fe624154810 2024-09-11T00:46:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe623200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6240c6530 con 0x7fe6240c4f60 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe621400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe621e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240c4f60 0x7fe624153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.776+0000 7fe621400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48402/0 (socket says 172.21.15.81:48402) 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 -- 172.21.15.81:0/1195955407 learned_addr learned my addr 172.21.15.81:0/1195955407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe622800640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe624154810 0x7fe62414b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 -- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240c4f60 msgr2=0x7fe624153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240c4f60 0x7fe624153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 -- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe624154810 msgr2=0x7fe62414b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe624154810 0x7fe62414b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 -- 172.21.15.81:0/1195955407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6241f1a60 con 0x7fe6240cc030 2024-09-11T00:46:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe621400640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b450 tx=0x7fe61000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe61a000640 1 -- 172.21.15.81:0/1195955407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610015020 con 0x7fe6240cc030 2024-09-11T00:46:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.777+0000 7fe61a000640 1 -- 172.21.15.81:0/1195955407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6100119a0 con 0x7fe6240cc030 2024-09-11T00:46:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.778+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6240b4f60 con 0x7fe6240cc030 2024-09-11T00:46:28.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.778+0000 7fe61a000640 1 -- 172.21.15.81:0/1195955407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610011df0 con 0x7fe6240cc030 2024-09-11T00:46:28.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.778+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6240b4b70 con 0x7fe6240cc030 2024-09-11T00:46:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.782+0000 7fe61a000640 1 -- 172.21.15.81:0/1195955407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe61001a400 con 0x7fe6240cc030 2024-09-11T00:46:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.783+0000 7fe62b9d3740 1 Processor -- start 2024-09-11T00:46:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.783+0000 7fe62b9d3740 1 -- start start 2024-09-11T00:46:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.783+0000 7fe61a000640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 0x7fe60407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.783+0000 7fe61a000640 1 -- 172.21.15.81:0/1195955407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe61009a4e0 con 0x7fe6240cc030 2024-09-11T00:46:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe622800640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 0x7fe60407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d65558d7c0 0x55d65558dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d655506260 con 0x55d6555940c0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d6554f5690 con 0x55d65558d7c0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55d6554f94a0 con 0x55d6555d1ba0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe621400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe621400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48412/0 (socket says 172.21.15.81:48412) 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe621400640 1 -- 172.21.15.81:0/3163011105 learned_addr learned my addr 172.21.15.81:0/3163011105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe622800640 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe621e00640 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d65558d7c0 0x55d65558dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.784+0000 7fe622800640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 0x7fe60407a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b5d60 tx=0x7fe61c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 -- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 msgr2=0x55d6555c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 -- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d65558d7c0 msgr2=0x55d65558dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d65558d7c0 0x55d65558dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 -- 172.21.15.81:0/3163011105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6552cfd80 con 0x55d6555940c0 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe621400640 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe610013000 tx=0x7fe610062090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2df3e5af1746291 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe60e600640 1 -- 172.21.15.81:0/3163011105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610088020 con 0x55d6555940c0 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe60e600640 1 -- 172.21.15.81:0/3163011105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe61006b9d0 con 0x55d6555940c0 2024-09-11T00:46:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.785+0000 7fe60e600640 1 -- 172.21.15.81:0/3163011105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61009a070 con 0x55d6555940c0 2024-09-11T00:46:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3163011105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 msgr2=0x55d655594800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe610013000 tx=0x7fe610062090 comp rx=0 tx=0).stop 2024-09-11T00:46:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3163011105 shutdown_connections 2024-09-11T00:46:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d655594800 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3163011105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d65558d7c0 0x55d65558dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3163011105 >> 172.21.15.81:0/3163011105 conn(0x55d65558f520 msgr2=0x55d655592df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3163011105 shutdown_connections 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.786+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3163011105 wait complete. 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.787+0000 7fe62b9d3740 1 -- start start 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.787+0000 7fe62b9d3740 1 Processor -- start 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 0x55d6555bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 0x55d6555bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d655265cc0 con 0x55d6555bc980 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d65549ae60 con 0x55d6555d1ba0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55d655593500 con 0x55d6555940c0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe62b9d3740 10 client.0 _ll_register_callbacks cb 0x55d6554a1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.788+0000 7fe622800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 0x55d6555bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 0x55d6555bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33446/0 (socket says 172.21.15.81:33446) 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 -- 172.21.15.81:0/3840419160 learned_addr learned my addr 172.21.15.81:0/3840419160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 -- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 msgr2=0x55d6555bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 0x55d6555bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 -- 172.21.15.81:0/3840419160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 msgr2=0x55d6555bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 0x55d6555bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621e00640 1 -- 172.21.15.81:0/3840419160 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55d655330510 con 0x55d6555940c0 2024-09-11T00:46:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe621400640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 0x55d6555bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.789+0000 7fe622800640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 0x55d6555bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe621e00640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe614034040 tx=0x7fe6140043c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef92e0ca698061ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe602a00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614035040 con 0x55d6555940c0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe614003a00 con 0x55d6555940c0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe61006b9d0 con 0x55d6555940c0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe61404e050 con 0x55d6555940c0 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe62b9d3740 10 client.4751 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d655234c20 con 0x55d6555940c0 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.790+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe61006b9d0 con 0x55d6555940c0 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe614051020 con 0x55d6555940c0 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 10 client.4751 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 10 client.4751 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 20 client.4751 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555babd0 0x55d6555e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 4 client.4751 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6555081b0 con 0x55d6555babd0 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.791+0000 7fe621400640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555babd0 0x55d6555e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.792+0000 7fe602a00640 10 client.4751 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.792+0000 7fe621400640 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555babd0 0x55d6555e71c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee45c82e95a7a44 server_cookie=f808d65738408c5a in_seq=0 out_seq=0 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe602a00640 1 -- 172.21.15.81:0/3840419160 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6555081b0 con 0x55d6555babd0 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe602a00640 10 client.4751 handle_command_reply: tid=0 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 client.4751 shutdown 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 msgr2=0x55d6555bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe614034040 tx=0x7fe6140043c0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 shutdown_connections 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555babd0 0x55d6555e71c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555bc980 0x55d6555bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555d1ba0 0x55d6555bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe602a00640 0 client.4751 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3840419160 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555940c0 0x55d6555bb680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 >> 172.21.15.81:0/3840419160 conn(0x55d65558d7c0 msgr2=0x55d6555c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 shutdown_connections 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.793+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3840419160 wait complete. 2024-09-11T00:46:28.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.794+0000 7fe62b9d3740 20 client.4751 trim_cache size 0 max 16384 2024-09-11T00:46:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.815+0000 7fe62b9d3740 1 Processor -- start 2024-09-11T00:46:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.815+0000 7fe62b9d3740 1 -- start start 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 0x55d6555949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6241ff250 con 0x55d6555940c0 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6241fe130 con 0x55d6555bc980 2024-09-11T00:46:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe624150860 con 0x55d6555d1ba0 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe621e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe621e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48432/0 (socket says 172.21.15.81:48432) 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.816+0000 7fe621e00640 1 -- 172.21.15.81:0/3197523484 learned_addr learned my addr 172.21.15.81:0/3197523484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621400640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 0x55d6555949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe622800640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 -- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 msgr2=0x55d6555bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 -- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 msgr2=0x55d6555949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 0x55d6555949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 -- 172.21.15.81:0/3197523484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6555bd170 con 0x55d6555940c0 2024-09-11T00:46:28.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621400640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 0x55d6555949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:46:28.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe622800640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:46:28.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe621e00640 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe614001eb0 tx=0x7fe614003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f785b80579d5d21f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe60dc00640 1 -- 172.21.15.81:0/3197523484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614035070 con 0x55d6555940c0 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe60dc00640 1 -- 172.21.15.81:0/3197523484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe614005850 con 0x55d6555940c0 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.817+0000 7fe60dc00640 1 -- 172.21.15.81:0/3197523484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61403dab0 con 0x55d6555940c0 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.818+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3197523484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 msgr2=0x55d6555944a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.818+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe614001eb0 tx=0x7fe614003a10 comp rx=0 tx=0).stop 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3197523484 shutdown_connections 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555d1ba0 0x55d6555bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555bc980 0x55d6555949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3197523484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555940c0 0x55d6555944a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3197523484 >> 172.21.15.81:0/3197523484 conn(0x55d65558d7c0 msgr2=0x55d655591780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3197523484 shutdown_connections 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.819+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3197523484 wait complete. 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.820+0000 7fe62b9d3740 1 -- start start 2024-09-11T00:46:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.820+0000 7fe62b9d3740 1 Processor -- start 2024-09-11T00:46:28.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555940c0 0x55d65564d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555d1ba0 0x55d655592fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe624159250 con 0x55d6555d1ba0 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6241fdac0 con 0x55d6555940c0 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6241fd470 con 0x55d6555bc980 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.821+0000 7fe62b9d3740 10 client.0 _ll_register_callbacks cb 0x7fe614004190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33464/0 (socket says 172.21.15.81:33464) 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 -- 172.21.15.81:0/3812923064 learned_addr learned my addr 172.21.15.81:0/3812923064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 -- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555940c0 msgr2=0x55d65564d8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:46:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555940c0 0x55d65564d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 -- 172.21.15.81:0/3812923064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555d1ba0 msgr2=0x55d655592fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555d1ba0 0x55d655592fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.822+0000 7fe621400640 1 -- 172.21.15.81:0/3812923064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55d6555c5010 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe621400640 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe610062510 tx=0x7fe6100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bdc55358d6d9c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe602a00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610088040 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe6100619e0 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe614005850 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.823+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe610097050 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 10 client.4757 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d655594a50 con 0x55d6555bc980 2024-09-11T00:46:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe614005850 con 0x55d6555bc980 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe6100691b0 con 0x55d6555bc980 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 10 client.4757 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 10 client.4757 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 20 client.4757 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555f36b0 0x55d655593520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 4 client.4757 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.824+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x55d655503c60 con 0x55d6555f36b0 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.825+0000 7fe621e00640 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555f36b0 0x55d655593520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.825+0000 7fe621e00640 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555f36b0 0x55d655593520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2718062a9854ecb server_cookie=8769bd2ac05fc43a in_seq=0 out_seq=0 2024-09-11T00:46:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.825+0000 7fe602a00640 10 client.4757 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe602a00640 1 -- 172.21.15.81:0/3812923064 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55d655503c60 con 0x55d6555f36b0 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe602a00640 10 client.4757 handle_command_reply: tid=0 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 client.4757 shutdown 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 msgr2=0x55d65564dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe610062510 tx=0x7fe6100046c0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 shutdown_connections 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d6555f36b0 0x55d655593520 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6555d1ba0 0x55d655592fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d6555bc980 0x55d65564dde0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe602a00640 0 client.4757 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 --2- 172.21.15.81:0/3812923064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d6555940c0 0x55d65564d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 >> 172.21.15.81:0/3812923064 conn(0x55d65558d7c0 msgr2=0x55d65558dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 shutdown_connections 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.990+0000 7fe62b9d3740 1 -- 172.21.15.81:0/3812923064 wait complete. 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe62b9d3740 20 client.4757 trim_cache size 0 max 16384 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:46:28.994 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 6, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "dfe167c": { 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 6, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 140.5, 2024-09-11T00:46:28.995 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:28.996 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:46:28.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 msgr2=0x7fe60407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 0x7fe60407a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b5d60 tx=0x7fe61c009040 comp rx=0 tx=0).stop 2024-09-11T00:46:28.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 msgr2=0x7fe6241f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b450 tx=0x7fe61000b910 comp rx=0 tx=0).stop 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 shutdown_connections 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe604077f70 0x7fe60407a430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe624154810 0x7fe62414b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240cc030 0x7fe6241f4380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 --2- 172.21.15.81:0/1195955407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6240c4f60 0x7fe624153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.991+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 >> 172.21.15.81:0/1195955407 conn(0x7fe6240688e0 msgr2=0x7fe624159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.992+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 shutdown_connections 2024-09-11T00:46:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:28.992+0000 7fe623200640 1 -- 172.21.15.81:0/1195955407 wait complete. 2024-09-11T00:46:29.010 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dfe167c', quiesce took 0.9 seconds. Will release after: 19.6 2024-09-11T00:46:41.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:41.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:46:48.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:46:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 -- 172.21.15.81:0/656532304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75300c7fd0 msgr2=0x7f7530072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 --2- 172.21.15.81:0/656532304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75300c7fd0 0x7f7530072650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7518005fd0 tx=0x7f751802a5d0 comp rx=0 tx=0).stop 2024-09-11T00:46:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 -- 172.21.15.81:0/656532304 shutdown_connections 2024-09-11T00:46:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 --2- 172.21.15.81:0/656532304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7530154ad0 0x7f7530073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 --2- 172.21.15.81:0/656532304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75300c7fd0 0x7f7530072650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 -- 172.21.15.81:0/656532304 >> 172.21.15.81:0/656532304 conn(0x7f75300700f0 msgr2=0x7f7530070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 -- 172.21.15.81:0/656532304 shutdown_connections 2024-09-11T00:46:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.777+0000 7f7536800640 1 -- 172.21.15.81:0/656532304 wait complete. 2024-09-11T00:46:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.778+0000 7f7536800640 1 Processor -- start 2024-09-11T00:46:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.778+0000 7f7536800640 1 -- start start 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75300c7bf0 0x7f75300c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7530154ad0 0x7f75301f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7530073250 con 0x7f75300c7fd0 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f753015b2f0 con 0x7f7530154ad0 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.779+0000 7f7536800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f753015a610 con 0x7f75300c7bf0 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35172/0 (socket says 172.21.15.81:35172) 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f752fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7530154ad0 0x7f75301f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 -- 172.21.15.81:0/585185674 learned_addr learned my addr 172.21.15.81:0/585185674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f752f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75300c7bf0 0x7f75300c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 -- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75300c7bf0 msgr2=0x7f75300c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75300c7bf0 0x7f75300c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 -- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7530154ad0 msgr2=0x7f75301f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7530154ad0 0x7f75301f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 -- 172.21.15.81:0/585185674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300c6250 con 0x7f75300c7fd0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.780+0000 7f7526a00640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7518006010 tx=0x7f75180035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.781+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751803f070 con 0x7f75300c7fd0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.781+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7518003ce0 con 0x7f75300c7fd0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.781+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518035030 con 0x7f75300c7fd0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.781+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75300cba00 con 0x7f75300c7fd0 2024-09-11T00:46:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.781+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300cb0d0 con 0x7f75300c7fd0 2024-09-11T00:46:48.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.782+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530158250 con 0x7f75300c7fd0 2024-09-11T00:46:48.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.783+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7518004a00 con 0x7f75300c7fd0 2024-09-11T00:46:48.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.784+0000 7f7527e00640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 0x7f750c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:48.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.784+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f75180baf00 con 0x7f75300c7fd0 2024-09-11T00:46:48.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.784+0000 7f752f400640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 0x7f750c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:48.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.785+0000 7f752f400640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 0x7f750c07a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75300b16f0 tx=0x7f7520009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:48.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:48.788+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7530158250 con 0x7f75300c7fd0 2024-09-11T00:46:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.006+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7530070c10 con 0x7f75300c7fd0 2024-09-11T00:46:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.006+0000 7f7527e00640 1 -- 172.21.15.81:0/585185674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f7518082f30 con 0x7f75300c7fd0 2024-09-11T00:46:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:46:49.008 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:46:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 msgr2=0x7f750c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 0x7f750c07a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75300b16f0 tx=0x7f7520009040 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 msgr2=0x7f75301f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7518006010 tx=0x7f75180035f0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 shutdown_connections 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f750c077f70 0x7f750c07a430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7530154ad0 0x7f75301f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75300c7fd0 0x7f75301f0af0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 --2- 172.21.15.81:0/585185674 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75300c7bf0 0x7f75300c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 >> 172.21.15.81:0/585185674 conn(0x7f75300700f0 msgr2=0x7f75300704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 shutdown_connections 2024-09-11T00:46:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.009+0000 7f7536800640 1 -- 172.21.15.81:0/585185674 wait complete. 2024-09-11T00:46:49.026 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id dfe167c --release --await' 2024-09-11T00:46:49.026 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id dfe167c --release --await 2024-09-11T00:46:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 -- 172.21.15.81:0/1520185434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 msgr2=0x7fa568070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 --2- 172.21.15.81:0/1520185434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa568070c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa568072130 tx=0x7fa55802aa30 comp rx=0 tx=0).stop 2024-09-11T00:46:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 -- 172.21.15.81:0/1520185434 shutdown_connections 2024-09-11T00:46:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 --2- 172.21.15.81:0/1520185434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa56815baa0 0x7fa56815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 --2- 172.21.15.81:0/1520185434 >> v2:172.21.15.167:3300/0 conn(0x7fa5680c7360 0x7fa5680c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 --2- 172.21.15.81:0/1520185434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa568070c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 -- 172.21.15.81:0/1520185434 >> 172.21.15.81:0/1520185434 conn(0x7fa56806ff90 msgr2=0x7fa5680703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 -- 172.21.15.81:0/1520185434 shutdown_connections 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.188+0000 7fa56ec00640 1 -- 172.21.15.81:0/1520185434 wait complete. 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.190+0000 7fa56ec00640 1 Processor -- start 2024-09-11T00:46:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.190+0000 7fa56ec00640 1 -- start start 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5680c7360 0x7fa5681545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56815baa0 0x7fa568155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa568074ad0 con 0x7fa56806f760 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa568159330 con 0x7fa56815baa0 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa56ec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa568074db0 con 0x7fa5680c7360 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa567e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa567e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35192/0 (socket says 172.21.15.81:35192) 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.191+0000 7fa567e00640 1 -- 172.21.15.81:0/2882154721 learned_addr learned my addr 172.21.15.81:0/2882154721 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56815baa0 0x7fa568155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567400640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5680c7360 0x7fa5681545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 -- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5680c7360 msgr2=0x7fa5681545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5680c7360 0x7fa5681545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 -- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56815baa0 msgr2=0x7fa568155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56815baa0 0x7fa568155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 -- 172.21.15.81:0/2882154721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5681e21b0 con 0x7fa56806f760 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa567e00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa558009bf0 tx=0x7fa558003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa55fe00640 1 -- 172.21.15.81:0/2882154721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558047070 con 0x7fa56806f760 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa55fe00640 1 -- 172.21.15.81:0/2882154721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa55802f690 con 0x7fa56806f760 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5681f2b00 con 0x7fa56806f760 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.192+0000 7fa55fe00640 1 -- 172.21.15.81:0/2882154721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558033050 con 0x7fa56806f760 2024-09-11T00:46:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.193+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5681f2820 con 0x7fa56806f760 2024-09-11T00:46:49.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.196+0000 7fa55fe00640 1 -- 172.21.15.81:0/2882154721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa5580044b0 con 0x7fa56806f760 2024-09-11T00:46:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.196+0000 7fa55fe00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 0x7fa54807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.197+0000 7fa55fe00640 1 -- 172.21.15.81:0/2882154721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa5580bb4b0 con 0x7fa56806f760 2024-09-11T00:46:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.197+0000 7fa571c74740 1 Processor -- start 2024-09-11T00:46:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.197+0000 7fa571c74740 1 -- start start 2024-09-11T00:46:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.197+0000 7fa567400640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 0x7fa54807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c6f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c34910 0x560515c6f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560515bac370 con 0x560515c37b80 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560515b9b7a0 con 0x560515c34910 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560515b9f5b0 con 0x560515c79810 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567400640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 0x7fa54807a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa56806d300 tx=0x7fa554005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35200/0 (socket says 172.21.15.81:35200) 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 -- 172.21.15.81:0/3980506112 learned_addr learned my addr 172.21.15.81:0/3980506112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567400640 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c6f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa56cc00640 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c34910 0x560515c6f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 -- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 msgr2=0x560515c6f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c6f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 -- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c34910 msgr2=0x560515c6f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c34910 0x560515c6f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.198+0000 7fa567e00640 1 -- 172.21.15.81:0/3980506112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560515b34010 con 0x560515c37b80 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa567e00640 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b96a0 tx=0x7fa558082df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6577086b423c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa553e00640 1 -- 172.21.15.81:0/3980506112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55808c420 con 0x560515c37b80 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa553e00640 1 -- 172.21.15.81:0/3980506112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5580880b0 con 0x560515c37b80 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa553e00640 1 -- 172.21.15.81:0/3980506112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55808cad0 con 0x560515c37b80 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa571c74740 1 -- 172.21.15.81:0/3980506112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 msgr2=0x560515c82c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.199+0000 7fa571c74740 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b96a0 tx=0x7fa558082df0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 -- 172.21.15.81:0/3980506112 shutdown_connections 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c34910 0x560515c6f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c6f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 --2- 172.21.15.81:0/3980506112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c37b80 0x560515c82c20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 -- 172.21.15.81:0/3980506112 >> 172.21.15.81:0/3980506112 conn(0x560515c35d60 msgr2=0x560515c37240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 -- 172.21.15.81:0/3980506112 shutdown_connections 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 -- 172.21.15.81:0/3980506112 wait complete. 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 -- start start 2024-09-11T00:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.200+0000 7fa571c74740 1 Processor -- start 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c6e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c89b50 0x560515c6af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560515b42f70 con 0x560515c79810 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560515b41090 con 0x560515c89b50 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560515bac370 con 0x560515c37b80 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.201+0000 7fa571c74740 10 client.0 _ll_register_callbacks cb 0x5605158aa110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35214/0 (socket says 172.21.15.81:35214) 2024-09-11T00:46:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 -- 172.21.15.81:0/1982082715 learned_addr learned my addr 172.21.15.81:0/1982082715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567e00640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c6e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa56cc00640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c89b50 0x560515c6af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 -- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 msgr2=0x560515c6e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c6e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 -- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c89b50 msgr2=0x560515c6af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c89b50 0x560515c6af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 -- 172.21.15.81:0/1982082715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605158fdea0 con 0x560515c79810 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa567400640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa554011f80 tx=0x7fa554004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3201c9a15edc708 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.202+0000 7fa550c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55401e830 con 0x560515c79810 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5580880b0 con 0x560515c79810 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa55401e9d0 con 0x560515c79810 2024-09-11T00:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa554030050 con 0x560515c79810 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 10 client.4953 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560515976d30 con 0x560515c79810 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5580880b0 con 0x560515c79810 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fa554033020 con 0x560515c79810 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 10 client.4953 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 10 client.4953 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 20 client.4953 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515c6b480 0x560515c77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 4 client.4953 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.203+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560515bae2c0 con 0x560515c6b480 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.204+0000 7fa567e00640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515c6b480 0x560515c77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.204+0000 7fa567e00640 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515c6b480 0x560515c77e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40805818d22f4957 server_cookie=35efe1e7d7f1bfb0 in_seq=0 out_seq=0 2024-09-11T00:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.204+0000 7fa550c00640 10 client.4953 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.205+0000 7fa550c00640 1 -- 172.21.15.81:0/1982082715 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560515bae2c0 con 0x560515c6b480 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.205+0000 7fa550c00640 10 client.4953 handle_command_reply: tid=0 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.205+0000 7fa571c74740 1 client.4953 shutdown 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 msgr2=0x560515c76710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa554011f80 tx=0x7fa554004730 comp rx=0 tx=0).stop 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 shutdown_connections 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515c6b480 0x560515c77e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c89b50 0x560515c6af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515c76710 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa550c00640 0 client.4953 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 --2- 172.21.15.81:0/1982082715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c6e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 >> 172.21.15.81:0/1982082715 conn(0x560515c34910 msgr2=0x560515c39d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 shutdown_connections 2024-09-11T00:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 1 -- 172.21.15.81:0/1982082715 wait complete. 2024-09-11T00:46:49.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.206+0000 7fa571c74740 20 client.4953 trim_cache size 0 max 16384 2024-09-11T00:46:49.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.224+0000 7fa571c74740 1 Processor -- start 2024-09-11T00:46:49.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.224+0000 7fa571c74740 1 -- start start 2024-09-11T00:46:49.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c37b80 0x560515c340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c39af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5681fd000 con 0x560515c3a030 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5681fbee0 con 0x560515c37b80 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa568153700 con 0x560515c79810 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35228/0 (socket says 172.21.15.81:35228) 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 -- 172.21.15.81:0/2519261773 learned_addr learned my addr 172.21.15.81:0/2519261773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa567400640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c39af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa567e00640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c37b80 0x560515c340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 -- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 msgr2=0x560515c39af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c39af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 -- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c37b80 msgr2=0x560515c340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c37b80 0x560515c340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa56cc00640 1 -- 172.21.15.81:0/2519261773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560515c7ce20 con 0x560515c3a030 2024-09-11T00:46:49.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.225+0000 7fa567400640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c39af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:46:49.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa560009cc0 tx=0x7fa560005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca77673da07f55a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa553400640 1 -- 172.21.15.81:0/2519261773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600120d0 con 0x560515c3a030 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa553400640 1 -- 172.21.15.81:0/2519261773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa560012270 con 0x560515c3a030 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa553400640 1 -- 172.21.15.81:0/2519261773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560005260 con 0x560515c3a030 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 -- 172.21.15.81:0/2519261773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 msgr2=0x560515c86a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa560009cc0 tx=0x7fa560005f90 comp rx=0 tx=0).stop 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 -- 172.21.15.81:0/2519261773 shutdown_connections 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c3a030 0x560515c86a90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c79810 0x560515c39af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 --2- 172.21.15.81:0/2519261773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c37b80 0x560515c340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.226+0000 7fa571c74740 1 -- 172.21.15.81:0/2519261773 >> 172.21.15.81:0/2519261773 conn(0x560515c34910 msgr2=0x560515c351d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.227+0000 7fa571c74740 1 -- 172.21.15.81:0/2519261773 shutdown_connections 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.227+0000 7fa571c74740 1 -- 172.21.15.81:0/2519261773 wait complete. 2024-09-11T00:46:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.227+0000 7fa571c74740 1 -- start start 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.227+0000 7fa571c74740 1 Processor -- start 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c86c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c3a030 0x560515cfd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5681fac90 con 0x560515c79810 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5681fb810 con 0x560515c3a030 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa5681fb180 con 0x560515c37b80 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.228+0000 7fa571c74740 10 client.0 _ll_register_callbacks cb 0x7fa554011bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35232/0 (socket says 172.21.15.81:35232) 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 -- 172.21.15.81:0/2368290394 learned_addr learned my addr 172.21.15.81:0/2368290394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa567400640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c3a030 0x560515cfd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa567e00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 -- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 msgr2=0x560515c86c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c86c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 -- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c3a030 msgr2=0x560515cfd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c3a030 0x560515cfd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 -- 172.21.15.81:0/2368290394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560515c77030 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa56cc00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa56001e040 tx=0x7fa560005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754f7a8594ad7baa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.229+0000 7fa550c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56002b070 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa5600047a0 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa560012270 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa560038050 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 10 client.4959 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560515d03830 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa560012270 con 0x560515c79810 2024-09-11T00:46:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fa56003b020 con 0x560515c79810 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 10 client.4959 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 10 client.4959 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 20 client.4959 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515d033a0 0x560515c7d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 4 client.4959 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dfe167c", "release": true, "await": true}] 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.230+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dfe167c", "release": true, "await": true}) -- 0x560515ba9d70 con 0x560515d033a0 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.231+0000 7fa567e00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515d033a0 0x560515c7d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.231+0000 7fa550c00640 10 client.4959 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.231+0000 7fa567e00640 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515d033a0 0x560515c7d8f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3409ed3c1f450005 server_cookie=6a6f59b7bf1a8af6 in_seq=0 out_seq=0 2024-09-11T00:46:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa550c00640 1 -- 172.21.15.81:0/2368290394 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x560515ba9d70 con 0x560515d033a0 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa550c00640 10 client.4959 handle_command_reply: tid=0 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 client.4959 shutdown 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 msgr2=0x560515cfd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa56001e040 tx=0x7fa560005770 comp rx=0 tx=0).stop 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 shutdown_connections 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x560515d033a0 0x560515c7d8f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560515c79810 0x560515cfd770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560515c3a030 0x560515cfd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 --2- 172.21.15.81:0/2368290394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560515c37b80 0x560515c86c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 >> 172.21.15.81:0/2368290394 conn(0x560515c34910 msgr2=0x560515c351d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa550c00640 0 client.4959 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 shutdown_connections 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 1 -- 172.21.15.81:0/2368290394 wait complete. 2024-09-11T00:46:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.247+0000 7fa571c74740 20 client.4959 trim_cache size 0 max 16384 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 8, 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dfe167c": { 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 8, 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:46:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 140.5, 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:49.252 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:46:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 msgr2=0x7fa54807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 0x7fa54807a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa56806d300 tx=0x7fa554005f90 comp rx=0 tx=0).stop 2024-09-11T00:46:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 msgr2=0x7fa5681ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa558009bf0 tx=0x7fa558003f10 comp rx=0 tx=0).stop 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 shutdown_connections 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa548077f70 0x7fa54807a430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56815baa0 0x7fa568155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5680c7360 0x7fa5681545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 --2- 172.21.15.81:0/2882154721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56806f760 0x7fa5681ee6c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 >> 172.21.15.81:0/2882154721 conn(0x7fa56806ff90 msgr2=0x7fa5681584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 shutdown_connections 2024-09-11T00:46:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.248+0000 7fa56ec00640 1 -- 172.21.15.81:0/2882154721 wait complete. 2024-09-11T00:46:49.265 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dfe167c', total seconds elapsed: 21.2 2024-09-11T00:46:49.266 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-11T00:46:49.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:46:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 -- 172.21.15.81:0/2985544426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc0c4f50 msgr2=0x7f9dfc15af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 --2- 172.21.15.81:0/2985544426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc15af30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0caed0 tx=0x7f9df402a940 comp rx=0 tx=0).stop 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 -- 172.21.15.81:0/2985544426 shutdown_connections 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 --2- 172.21.15.81:0/2985544426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc15af30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 -- 172.21.15.81:0/2985544426 >> 172.21.15.81:0/2985544426 conn(0x7f9dfc06ebb0 msgr2=0x7f9dfc06efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 -- 172.21.15.81:0/2985544426 shutdown_connections 2024-09-11T00:46:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.443+0000 7f9e01e00640 1 -- 172.21.15.81:0/2985544426 wait complete. 2024-09-11T00:46:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.445+0000 7f9e01e00640 1 Processor -- start 2024-09-11T00:46:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.445+0000 7f9e01e00640 1 -- start start 2024-09-11T00:46:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dfc0cbe90 0x7f9dfc1effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 0x7f9dfc153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc15dd60 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc15e0d0 con 0x7f9dfc1548e0 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9dfc0cb5a0 con 0x7f9dfc0cbe90 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35236/0 (socket says 172.21.15.81:35236) 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e00a00640 1 -- 172.21.15.81:0/1815977417 learned_addr learned my addr 172.21.15.81:0/1815977417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9e01400640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 0x7f9dfc153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.446+0000 7f9df3e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dfc0cbe90 0x7f9dfc1effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 -- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dfc0cbe90 msgr2=0x7f9dfc1effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dfc0cbe90 0x7f9dfc1effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 -- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 msgr2=0x7f9dfc153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 0x7f9dfc153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 -- 172.21.15.81:0/1815977417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc1ea6f0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e01400640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 0x7f9dfc153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:46:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.447+0000 7f9e00a00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c3a0 tx=0x7f9dec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.448+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec017070 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.448+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dec0053c0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.448+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec003850 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.448+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc1550d0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.448+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc155690 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.449+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc15af30 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.450+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9dec0039f0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.451+0000 7f9df9600640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 0x7f9dd807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.451+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9dec099520 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.452+0000 7f9df3e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 0x7f9dd807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.452+0000 7f9df3e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 0x7f9dd807a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc15cf60 tx=0x7f9de4001830 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.455+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9dfc1ea6f0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.732+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dfc155860 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.733+0000 7f9df9600640 1 -- 172.21.15.81:0/1815977417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f9dec0617d0 con 0x7f9dfc0c4f50 2024-09-11T00:46:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:46:49.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:46:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.735+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 msgr2=0x7f9dd807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.735+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 0x7f9dd807a480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc15cf60 tx=0x7f9de4001830 comp rx=0 tx=0).stop 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.735+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 msgr2=0x7f9dfc14adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.735+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c3a0 tx=0x7f9dec00c860 comp rx=0 tx=0).stop 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 shutdown_connections 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9dd8077fc0 0x7f9dd807a480 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dfc1548e0 0x7f9dfc153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dfc0cbe90 0x7f9dfc1effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 --2- 172.21.15.81:0/1815977417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc0c4f50 0x7f9dfc14adb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 >> 172.21.15.81:0/1815977417 conn(0x7f9dfc06ebb0 msgr2=0x7f9dfc15a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 shutdown_connections 2024-09-11T00:46:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.736+0000 7f9e01e00640 1 -- 172.21.15.81:0/1815977417 wait complete. 2024-09-11T00:46:49.755 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-11T00:46:49.756 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-11T00:46:49.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 -- 172.21.15.81:0/2362367996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 msgr2=0x7fc6fc004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 --2- 172.21.15.81:0/2362367996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc6fc004060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc708006f00 tx=0x7fc6fc005830 comp rx=0 tx=0).stop 2024-09-11T00:46:49.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc717e00640 1 -- 172.21.15.81:0/2362367996 reap_dead start 2024-09-11T00:46:49.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 -- 172.21.15.81:0/2362367996 shutdown_connections 2024-09-11T00:46:49.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 -- 172.21.15.81:0/2362367996 >> 172.21.15.81:0/2362367996 conn(0x7fc71806ee50 msgr2=0x7fc71806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 -- 172.21.15.81:0/2362367996 shutdown_connections 2024-09-11T00:46:49.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.946+0000 7fc71d200640 1 -- 172.21.15.81:0/2362367996 wait complete. 2024-09-11T00:46:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.948+0000 7fc71d200640 1 Processor -- start 2024-09-11T00:46:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.948+0000 7fc71d200640 1 -- start start 2024-09-11T00:46:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7180b5d40 0x7fc7181f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 0x7fc71814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180693d0 con 0x7fc6fc003c60 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180698f0 con 0x7fc7180b5d40 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc71d200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180c5650 con 0x7fc7181f0b30 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35248/0 (socket says 172.21.15.81:35248) 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 -- 172.21.15.81:0/487871854 learned_addr learned my addr 172.21.15.81:0/487871854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc716a00640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7180b5d40 0x7fc7181f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717e00640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 0x7fc71814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 -- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 msgr2=0x7fc71814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 0x7fc71814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 -- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7180b5d40 msgr2=0x7fc7181f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7180b5d40 0x7fc7181f05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717400640 1 -- 172.21.15.81:0/487871854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7181f10b0 con 0x7fc6fc003c60 2024-09-11T00:46:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.949+0000 7fc717e00640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 0x7fc71814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:46:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc717400640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c290 tx=0x7fc708004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc70f400640 1 -- 172.21.15.81:0/487871854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708032030 con 0x7fc6fc003c60 2024-09-11T00:46:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc70f400640 1 -- 172.21.15.81:0/487871854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7080060c0 con 0x7fc6fc003c60 2024-09-11T00:46:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7180cf950 con 0x7fc6fc003c60 2024-09-11T00:46:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc70f400640 1 -- 172.21.15.81:0/487871854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708001bb0 con 0x7fc6fc003c60 2024-09-11T00:46:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.950+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181e4390 con 0x7fc6fc003c60 2024-09-11T00:46:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.953+0000 7fc70f400640 1 -- 172.21.15.81:0/487871854 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc70803f070 con 0x7fc6fc003c60 2024-09-11T00:46:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.954+0000 7fc70f400640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 0x7fc6f807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.954+0000 7fc70f400640 1 -- 172.21.15.81:0/487871854 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc7080ba5d0 con 0x7fc6fc003c60 2024-09-11T00:46:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.954+0000 7fc716a00640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 0x7fc6f807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.954+0000 7fc72166f740 1 Processor -- start 2024-09-11T00:46:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 -- start start 2024-09-11T00:46:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc716a00640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 0x7fc6f807a460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b6170 tx=0x7fc704005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8560 0x5565a24e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a24ea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565a245d260 con 0x5565a251fc00 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5565a244c690 con 0x5565a24e8560 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.955+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5565a24504a0 con 0x5565a24e8940 2024-09-11T00:46:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35252/0 (socket says 172.21.15.81:35252) 2024-09-11T00:46:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 -- 172.21.15.81:0/1928671045 learned_addr learned my addr 172.21.15.81:0/1928671045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717400640 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8560 0x5565a24e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc716a00640 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a24ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 -- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 msgr2=0x5565a24ea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a24ea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 -- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8560 msgr2=0x5565a24e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8560 0x5565a24e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.956+0000 7fc717e00640 1 -- 172.21.15.81:0/1928671045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a2226d80 con 0x5565a251fc00 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc717e00640 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc7180cab10 tx=0x7fc710001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3019c974998b8dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc703e00640 1 -- 172.21.15.81:0/1928671045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710006640 con 0x5565a251fc00 2024-09-11T00:46:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc703e00640 1 -- 172.21.15.81:0/1928671045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7100067e0 con 0x5565a251fc00 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc703e00640 1 -- 172.21.15.81:0/1928671045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7100116c0 con 0x5565a251fc00 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc72166f740 1 -- 172.21.15.81:0/1928671045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 msgr2=0x5565a2520080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.957+0000 7fc72166f740 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc7180cab10 tx=0x7fc710001de0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 -- 172.21.15.81:0/1928671045 shutdown_connections 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a2520080 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a24ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 --2- 172.21.15.81:0/1928671045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8560 0x5565a24e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 -- 172.21.15.81:0/1928671045 >> 172.21.15.81:0/1928671045 conn(0x5565a24e6740 msgr2=0x5565a24e7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 -- 172.21.15.81:0/1928671045 shutdown_connections 2024-09-11T00:46:49.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 -- 172.21.15.81:0/1928671045 wait complete. 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.958+0000 7fc72166f740 1 -- start start 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.959+0000 7fc72166f740 1 Processor -- start 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 0x5565a251b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a253dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565a21bccc0 con 0x5565a24e8940 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5565a23f1e60 con 0x5565a2513aa0 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5565a2515850 con 0x5565a251fc00 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc72166f740 10 client.0 _ll_register_callbacks cb 0x5565a23f8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc717400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc717400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35258/0 (socket says 172.21.15.81:35258) 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc717400640 1 -- 172.21.15.81:0/1738180150 learned_addr learned my addr 172.21.15.81:0/1738180150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc717e00640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a253dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.960+0000 7fc716a00640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 0x5565a251b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 -- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 msgr2=0x5565a251b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 0x5565a251b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 -- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 msgr2=0x5565a253dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a253dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 -- 172.21.15.81:0/1738180150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a2287510 con 0x5565a24e8940 2024-09-11T00:46:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc716a00640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 0x5565a251b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:46:49.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc717400640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7080822e0 tx=0x7fc708082b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c43393891cbd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc700c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:46:49.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080ba2d0 con 0x5565a24e8940 2024-09-11T00:46:49.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc708081840 con 0x5565a24e8940 2024-09-11T00:46:49.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7100067e0 con 0x5565a24e8940 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc7080820f0 con 0x5565a24e8940 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc72166f740 10 client.4977 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.961+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5565a218bc20 con 0x5565a24e8940 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7100067e0 con 0x5565a24e8940 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc70809c080 con 0x5565a24e8940 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 10 client.4977 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 10 client.4977 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 20 client.4977 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a253a5c0 0x5565a253a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 4 client.4977 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565a245f1b0 con 0x5565a253a5c0 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.962+0000 7fc716a00640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a253a5c0 0x5565a253a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.963+0000 7fc700c00640 10 client.4977 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.963+0000 7fc716a00640 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a253a5c0 0x5565a253a9e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181f04b3585f90c8 server_cookie=bd0e44dcf35fcdff in_seq=0 out_seq=0 2024-09-11T00:46:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc700c00640 1 -- 172.21.15.81:0/1738180150 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565a245f1b0 con 0x5565a253a5c0 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc700c00640 10 client.4977 handle_command_reply: tid=0 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 client.4977 shutdown 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 msgr2=0x5565a2519de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7080822e0 tx=0x7fc708082b80 comp rx=0 tx=0).stop 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 shutdown_connections 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a253a5c0 0x5565a253a9e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.964+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a253dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a251fc00 0x5565a251b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 1 --2- 172.21.15.81:0/1738180150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a24e8940 0x5565a2519de0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc700c00640 0 client.4977 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 >> 172.21.15.81:0/1738180150 conn(0x5565a24e8560 msgr2=0x5565a24e4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 shutdown_connections 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 1 -- 172.21.15.81:0/1738180150 wait complete. 2024-09-11T00:46:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.965+0000 7fc72166f740 20 client.4977 trim_cache size 0 max 16384 2024-09-11T00:46:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.991+0000 7fc72166f740 1 Processor -- start 2024-09-11T00:46:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.991+0000 7fc72166f740 1 -- start start 2024-09-11T00:46:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a251a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a251a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181ffb50 con 0x5565a251fc00 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181fea30 con 0x5565a2513aa0 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc7181fd150 con 0x5565a24e8940 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35270/0 (socket says 172.21.15.81:35270) 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc717e00640 1 -- 172.21.15.81:0/1112731247 learned_addr learned my addr 172.21.15.81:0/1112731247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc717400640 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a251a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.992+0000 7fc716a00640 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a251a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 -- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 msgr2=0x5565a251a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a251a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 -- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 msgr2=0x5565a251a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a251a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 -- 172.21.15.81:0/1112731247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a24e7510 con 0x5565a251fc00 2024-09-11T00:46:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc717e00640 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b3af0 tx=0x7fc710001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21dfbd2d48a87e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc703400640 1 -- 172.21.15.81:0/1112731247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710002050 con 0x5565a251fc00 2024-09-11T00:46:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc703400640 1 -- 172.21.15.81:0/1112731247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710006640 con 0x5565a251fc00 2024-09-11T00:46:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.993+0000 7fc703400640 1 -- 172.21.15.81:0/1112731247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7100126a0 con 0x5565a251fc00 2024-09-11T00:46:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 -- 172.21.15.81:0/1112731247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 msgr2=0x5565a251ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b3af0 tx=0x7fc710001670 comp rx=0 tx=0).stop 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 -- 172.21.15.81:0/1112731247 shutdown_connections 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a251ec50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a2513aa0 0x5565a251a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 --2- 172.21.15.81:0/1112731247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a24e8940 0x5565a251a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 -- 172.21.15.81:0/1112731247 >> 172.21.15.81:0/1112731247 conn(0x5565a24e8560 msgr2=0x5565a24e7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.994+0000 7fc72166f740 1 -- 172.21.15.81:0/1112731247 shutdown_connections 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.995+0000 7fc72166f740 1 -- 172.21.15.81:0/1112731247 wait complete. 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.995+0000 7fc72166f740 1 -- start start 2024-09-11T00:46:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.996+0000 7fc72166f740 1 Processor -- start 2024-09-11T00:46:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8940 0x5565a2537200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a2513aa0 0x5565a251a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181fd710 con 0x5565a251fc00 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181fe380 con 0x5565a24e8940 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc7181fdd60 con 0x5565a2513aa0 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc72166f740 10 client.0 _ll_register_callbacks cb 0x7fc70807e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35284/0 (socket says 172.21.15.81:35284) 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717e00640 1 -- 172.21.15.81:0/250565924 learned_addr learned my addr 172.21.15.81:0/250565924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717400640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8940 0x5565a2537200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc716a00640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a2513aa0 0x5565a251a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717e00640 1 -- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a2513aa0 msgr2=0x5565a251a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.997+0000 7fc717e00640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a2513aa0 0x5565a251a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc717e00640 1 -- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8940 msgr2=0x5565a2537200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:46:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc717e00640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8940 0x5565a2537200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc717e00640 1 -- 172.21.15.81:0/250565924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a2537740 con 0x5565a251fc00 2024-09-11T00:46:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc717e00640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc710013860 tx=0x7fc710013890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ebeee649740ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:46:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc700c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:46:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710031060 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc710013ab0 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.998+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc710006640 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc710037050 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 10 client.4983 fetch_fsmap learned FSMap version 9 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5565a2518560 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710006640 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc71003a020 con 0x5565a251fc00 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 10 client.4983 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 10 client.4983 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 20 client.4983 populate_metadata read hostname 'smithi081' 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a25a9100 0x5565a25aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 4 client.4983 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:49.999+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x5565a245ac60 con 0x5565a25a9100 2024-09-11T00:46:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.000+0000 7fc717400640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a25a9100 0x5565a25aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:46:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.000+0000 7fc717400640 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a25a9100 0x5565a25aefb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93459defb1f39856 server_cookie=c3108c0eda774044 in_seq=0 out_seq=0 2024-09-11T00:46:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.000+0000 7fc700c00640 10 client.4983 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc700c00640 1 -- 172.21.15.81:0/250565924 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5565a245ac60 con 0x5565a25a9100 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc700c00640 10 client.4983 handle_command_reply: tid=0 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 client.4983 shutdown 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 msgr2=0x5565a25a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc710013860 tx=0x7fc710013890 comp rx=0 tx=0).stop 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 shutdown_connections 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5565a25a9100 0x5565a25aefb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565a251fc00 0x5565a25a8bc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5565a2513aa0 0x5565a251a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 --2- 172.21.15.81:0/250565924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5565a24e8940 0x5565a2537200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc700c00640 0 client.4983 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 >> 172.21.15.81:0/250565924 conn(0x5565a24e8560 msgr2=0x5565a2509bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 shutdown_connections 2024-09-11T00:46:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 1 -- 172.21.15.81:0/250565924 wait complete. 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.062+0000 7fc72166f740 20 client.4983 trim_cache size 0 max 16384 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 10, 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "5b3b9278": { 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 10, 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 140.5, 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 msgr2=0x7fc6f807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 0x7fc6f807a460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7180b6170 tx=0x7fc704005f90 comp rx=0 tx=0).stop 2024-09-11T00:46:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 msgr2=0x7fc7181e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c290 tx=0x7fc708004dd0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 shutdown_connections 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc6f8077fa0 0x7fc6f807a460 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7181f0b30 0x7fc71814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7180b5d40 0x7fc7181f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 --2- 172.21.15.81:0/487871854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6fc003c60 0x7fc7181e3a90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 >> 172.21.15.81:0/487871854 conn(0x7fc71806ee50 msgr2=0x7fc7180d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 shutdown_connections 2024-09-11T00:46:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:46:50.063+0000 7fc71d200640 1 -- 172.21.15.81:0/487871854 wait complete. 2024-09-11T00:46:50.079 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5b3b9278', quiesce took 0.8 seconds. Will release after: 19.7 2024-09-11T00:47:09.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:47:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 -- 172.21.15.81:0/425177165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 msgr2=0x7fc008151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 --2- 172.21.15.81:0/425177165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc008151790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0080cbf10 tx=0x7fbff802a5c0 comp rx=0 tx=0).stop 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 -- 172.21.15.81:0/425177165 shutdown_connections 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 --2- 172.21.15.81:0/425177165 >> v2:172.21.15.167:3300/0 conn(0x7fc008157b30 0x7fc008157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 --2- 172.21.15.81:0/425177165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc008151790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 -- 172.21.15.81:0/425177165 >> 172.21.15.81:0/425177165 conn(0x7fc0080700f0 msgr2=0x7fc008070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 -- 172.21.15.81:0/425177165 shutdown_connections 2024-09-11T00:47:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.946+0000 7fc00d200640 1 -- 172.21.15.81:0/425177165 wait complete. 2024-09-11T00:47:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.948+0000 7fc00d200640 1 Processor -- start 2024-09-11T00:47:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.948+0000 7fc00d200640 1 -- start start 2024-09-11T00:47:09.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.948+0000 7fc00d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc008072650 0x7fc0081e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc00d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc00d200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc008157b30 0x7fc00814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc00d200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc00806ebd0 con 0x7fc0081513b0 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc00d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0080c83a0 con 0x7fc008072650 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc00d200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc00806f5e0 con 0x7fc008157b30 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38894/0 (socket says 172.21.15.81:38894) 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 -- 172.21.15.81:0/4138043408 learned_addr learned my addr 172.21.15.81:0/4138043408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc005e00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc008072650 0x7fc0081e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fc006800640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc008157b30 0x7fc00814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 -- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc008157b30 msgr2=0x7fc00814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc008157b30 0x7fc00814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:09.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 -- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc008072650 msgr2=0x7fc0081e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:09.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc008072650 0x7fc0081e1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:09.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.949+0000 7fbfffe00640 1 -- 172.21.15.81:0/4138043408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0080c1740 con 0x7fc0081513b0 2024-09-11T00:47:09.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fbfffe00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c950 tx=0x7fbff000ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0007c70 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff000f450 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000f8a0 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0081485e0 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.950+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0081f1af0 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.951+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc008070c10 con 0x7fc0081513b0 2024-09-11T00:47:09.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.952+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbff000fa40 con 0x7fc0081513b0 2024-09-11T00:47:09.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.953+0000 7fbffe000640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 0x7fbfe407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:09.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.953+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbff009a880 con 0x7fc0081513b0 2024-09-11T00:47:09.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.953+0000 7fc005e00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 0x7fbfe407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:09.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.954+0000 7fc005e00640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 0x7fbfe407a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbff8034000 tx=0x7fbff8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:09.957+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbff0014030 con 0x7fc0081513b0 2024-09-11T00:47:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.173+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc00806f1b0 con 0x7fc0081513b0 2024-09-11T00:47:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.174+0000 7fbffe000640 1 -- 172.21.15.81:0/4138043408 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fbff0062920 con 0x7fc0081513b0 2024-09-11T00:47:10.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:47:10.176 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:47:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 msgr2=0x7fbfe407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 0x7fbfe407a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbff8034000 tx=0x7fbff8004730 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 msgr2=0x7fc0081f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c950 tx=0x7fbff000ce10 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 shutdown_connections 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbfe4077f70 0x7fbfe407a430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc008157b30 0x7fc00814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0081513b0 0x7fc0081f2010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 --2- 172.21.15.81:0/4138043408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc008072650 0x7fc0081e1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 >> 172.21.15.81:0/4138043408 conn(0x7fc0080700f0 msgr2=0x7fc0080c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 shutdown_connections 2024-09-11T00:47:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.176+0000 7fc00d200640 1 -- 172.21.15.81:0/4138043408 wait complete. 2024-09-11T00:47:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 5b3b9278 --release --await' 2024-09-11T00:47:10.195 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 5b3b9278 --release --await 2024-09-11T00:47:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 -- 172.21.15.81:0/1654026700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 msgr2=0x7f94a0074dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 --2- 172.21.15.81:0/1654026700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a0074dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9490009860 tx=0x7f949002a620 comp rx=0 tx=0).stop 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 -- 172.21.15.81:0/1654026700 shutdown_connections 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 --2- 172.21.15.81:0/1654026700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a0074dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 -- 172.21.15.81:0/1654026700 >> 172.21.15.81:0/1654026700 conn(0x7f94a00c8990 msgr2=0x7f94a00c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 -- 172.21.15.81:0/1654026700 shutdown_connections 2024-09-11T00:47:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.356+0000 7f94a4c00640 1 -- 172.21.15.81:0/1654026700 wait complete. 2024-09-11T00:47:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.358+0000 7f94a4c00640 1 Processor -- start 2024-09-11T00:47:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.358+0000 7f94a4c00640 1 -- start start 2024-09-11T00:47:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94a01555a0 0x7f94a01f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94a00c73c0 con 0x7f94a00c94b0 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94a0158df0 con 0x7f94a01555a0 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f94a4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94a00c8280 con 0x7f94a0152550 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38906/0 (socket says 172.21.15.81:38906) 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 -- 172.21.15.81:0/35721986 learned_addr learned my addr 172.21.15.81:0/35721986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949ea00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949fe00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94a01555a0 0x7f94a01f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 -- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 msgr2=0x7f94a014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 -- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94a01555a0 msgr2=0x7f94a01f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94a01555a0 0x7f94a01f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.359+0000 7f949f400640 1 -- 172.21.15.81:0/35721986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a014cd70 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f949f400640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9490009980 tx=0x7f9490032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f9497400640 1 -- 172.21.15.81:0/35721986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490040070 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f9497400640 1 -- 172.21.15.81:0/35721986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94900038e0 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f9497400640 1 -- 172.21.15.81:0/35721986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490003cf0 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a0154ed0 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.360+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a01f81d0 con 0x7f94a00c94b0 2024-09-11T00:47:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.362+0000 7f9497400640 1 -- 172.21.15.81:0/35721986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9490045460 con 0x7f94a00c94b0 2024-09-11T00:47:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.363+0000 7f9497400640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 0x7f948007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.363+0000 7f9497400640 1 -- 172.21.15.81:0/35721986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f94900bb900 con 0x7f94a00c94b0 2024-09-11T00:47:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.363+0000 7f949ea00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 0x7f948007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.364+0000 7f94a91f7740 1 Processor -- start 2024-09-11T00:47:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.364+0000 7f94a91f7740 1 -- start start 2024-09-11T00:47:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.364+0000 7f949ea00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 0x7f948007a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f948c007fd0 tx=0x7f948c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b8097b20 0x5637b80d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b800f370 con 0x5637b809ad90 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5637b7ffe7a0 con 0x5637b80dca20 2024-09-11T00:47:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5637b80025b0 con 0x5637b8097b20 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38914/0 (socket says 172.21.15.81:38914) 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 -- 172.21.15.81:0/872334034 learned_addr learned my addr 172.21.15.81:0/872334034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949ea00640 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949fe00640 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b8097b20 0x5637b80d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 -- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b8097b20 msgr2=0x5637b80d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b8097b20 0x5637b80d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 -- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 msgr2=0x5637b80d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.365+0000 7f949f400640 1 -- 172.21.15.81:0/872334034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b7f97010 con 0x5637b809ad90 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f949f400640 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9490080bf0 tx=0x7f9490005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d561f5becf27a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f948b400640 1 -- 172.21.15.81:0/872334034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949004a040 con 0x5637b809ad90 2024-09-11T00:47:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f948b400640 1 -- 172.21.15.81:0/872334034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9490083980 con 0x5637b809ad90 2024-09-11T00:47:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f948b400640 1 -- 172.21.15.81:0/872334034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490088460 con 0x5637b809ad90 2024-09-11T00:47:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 -- 172.21.15.81:0/872334034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 msgr2=0x5637b80e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9490080bf0 tx=0x7f9490005f90 comp rx=0 tx=0).stop 2024-09-11T00:47:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 -- 172.21.15.81:0/872334034 shutdown_connections 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b8097b20 0x5637b80d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 --2- 172.21.15.81:0/872334034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80e5e30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.366+0000 7f94a91f7740 1 -- 172.21.15.81:0/872334034 >> 172.21.15.81:0/872334034 conn(0x5637b8098f70 msgr2=0x5637b809a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.367+0000 7f94a91f7740 1 -- 172.21.15.81:0/872334034 shutdown_connections 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.367+0000 7f94a91f7740 1 -- 172.21.15.81:0/872334034 wait complete. 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.367+0000 7f94a91f7740 1 -- start start 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.367+0000 7f94a91f7740 1 Processor -- start 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b80e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80d9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b7fa5f70 con 0x5637b80dca20 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5637b7fa4090 con 0x5637b809ad90 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5637b800f370 con 0x5637b80ed100 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.368+0000 7f94a91f7740 10 client.0 _ll_register_callbacks cb 0x5637b7d0d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b80e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:35576/0 (socket says 172.21.15.81:35576) 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949f400640 1 -- 172.21.15.81:0/3243998523 learned_addr learned my addr 172.21.15.81:0/3243998523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80d9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 -- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 msgr2=0x5637b80d9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80d9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 -- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 msgr2=0x5637b80e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 -- 172.21.15.81:0/3243998523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b7d60ea0 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949f400640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f949ea00640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b80e1fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f94a01f86f0 tx=0x7f948c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30fb5df2c9f6a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f947fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c027060 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f948c010040 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.369+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9490083980 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f948c00ea50 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 10 client.5004 fetch_fsmap learned FSMap version 9 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5637b7dd9d30 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9490083980 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f948c00ece0 con 0x5637b80dca20 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 10 client.5004 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 10 client.5004 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 20 client.5004 populate_metadata read hostname 'smithi081' 2024-09-11T00:47:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80d0d90 0x5637b80db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 4 client.5004 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:47:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.370+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637b80112c0 con 0x5637b80d0d90 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.371+0000 7f949f400640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80d0d90 0x5637b80db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.371+0000 7f949f400640 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80d0d90 0x5637b80db0a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a23ac704f8fd3ac server_cookie=3c78a8a6b92ef69a in_seq=0 out_seq=0 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.371+0000 7f947fe00640 10 client.5004 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f947fe00640 1 -- 172.21.15.81:0/3243998523 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637b80112c0 con 0x5637b80d0d90 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f947fe00640 10 client.5004 handle_command_reply: tid=0 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 client.5004 shutdown 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 msgr2=0x5637b80e1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b80e1fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f94a01f86f0 tx=0x7f948c001080 comp rx=0 tx=0).stop 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 shutdown_connections 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80d0d90 0x5637b80db0a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80d9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b80e1fc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3243998523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b80e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f947fe00640 0 client.5004 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 >> 172.21.15.81:0/3243998523 conn(0x5637b8097b20 msgr2=0x5637b80e07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 shutdown_connections 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 1 -- 172.21.15.81:0/3243998523 wait complete. 2024-09-11T00:47:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.372+0000 7f94a91f7740 20 client.5004 trim_cache size 0 max 16384 2024-09-11T00:47:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.390+0000 7f94a91f7740 1 Processor -- start 2024-09-11T00:47:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.390+0000 7f94a91f7740 1 -- start start 2024-09-11T00:47:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94a0203560 con 0x5637b809ad90 2024-09-11T00:47:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94a0202440 con 0x5637b80dca20 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94a014ffe0 con 0x5637b80ed100 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f949f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38926/0 (socket says 172.21.15.81:38926) 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f949f400640 1 -- 172.21.15.81:0/1894917357 learned_addr learned my addr 172.21.15.81:0/1894917357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f949fe00640 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.391+0000 7f949ea00640 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 -- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 msgr2=0x5637b80e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 -- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 msgr2=0x5637b80e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 -- 172.21.15.81:0/1894917357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b8095f40 con 0x5637b809ad90 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f949f400640 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f949007ff00 tx=0x7f949002a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e931917445c628dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f948aa00640 1 -- 172.21.15.81:0/1894917357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949004a040 con 0x5637b809ad90 2024-09-11T00:47:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f948aa00640 1 -- 172.21.15.81:0/1894917357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9490083be0 con 0x5637b809ad90 2024-09-11T00:47:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.392+0000 7f948aa00640 1 -- 172.21.15.81:0/1894917357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949008c9f0 con 0x5637b809ad90 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- 172.21.15.81:0/1894917357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 msgr2=0x5637b80dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f949007ff00 tx=0x7f949002a620 comp rx=0 tx=0).stop 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- 172.21.15.81:0/1894917357 shutdown_connections 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b80dca20 0x5637b80e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 --2- 172.21.15.81:0/1894917357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b809ad90 0x5637b80dfac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- 172.21.15.81:0/1894917357 >> 172.21.15.81:0/1894917357 conn(0x5637b8097b20 msgr2=0x5637b8098470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- 172.21.15.81:0/1894917357 shutdown_connections 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- 172.21.15.81:0/1894917357 wait complete. 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.393+0000 7f94a91f7740 1 -- start start 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 Processor -- start 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b81613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94a02010b0 con 0x5637b80dca20 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94a0201d70 con 0x5637b809ad90 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.394+0000 7f94a91f7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94a0201700 con 0x5637b80ed100 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f94a91f7740 10 client.0 _ll_register_callbacks cb 0x7f948c0050d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38934/0 (socket says 172.21.15.81:38934) 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 -- 172.21.15.81:0/3248912090 learned_addr learned my addr 172.21.15.81:0/3248912090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949f400640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b81613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949fe00640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 -- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 msgr2=0x5637b80e2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 -- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 msgr2=0x5637b81613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b81613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 -- 172.21.15.81:0/3248912090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b80e06f0 con 0x5637b80dca20 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f949ea00640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f948c003fd0 tx=0x7f948c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a5002766c9ac87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:47:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f947fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.395+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c027070 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f948c010070 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9490083be0 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f948c03a050 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 10 client.5010 fetch_fsmap learned FSMap version 9 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5637b815d4d0 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9490083be0 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f948c03d020 con 0x5637b80dca20 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 10 client.5010 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:47:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 10 client.5010 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 20 client.5010 populate_metadata read hostname 'smithi081' 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80ea2f0 0x5637b80e3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 4 client.5010 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5b3b9278", "release": true, "await": true}] 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.396+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5b3b9278", "release": true, "await": true}) -- 0x5637b800cd70 con 0x5637b80ea2f0 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.397+0000 7f949f400640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80ea2f0 0x5637b80e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.397+0000 7f947fe00640 10 client.5010 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:47:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.397+0000 7f949f400640 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80ea2f0 0x5637b80e3290 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07b8c1d3c6d2031 server_cookie=11611b0fb6eb1475 in_seq=0 out_seq=0 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f947fe00640 1 -- 172.21.15.81:0/3248912090 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5637b800cd70 con 0x5637b80ea2f0 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f947fe00640 10 client.5010 handle_command_reply: tid=0 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 client.5010 shutdown 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 msgr2=0x5637b815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f948c003fd0 tx=0x7f948c000f50 comp rx=0 tx=0).stop 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 shutdown_connections 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5637b80ea2f0 0x5637b80e3290 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5637b80ed100 0x5637b80e2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b80dca20 0x5637b815de20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 --2- 172.21.15.81:0/3248912090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637b809ad90 0x5637b81613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f947fe00640 0 client.5010 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.413+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 >> 172.21.15.81:0/3248912090 conn(0x5637b8097b20 msgr2=0x5637b80f02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 shutdown_connections 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a91f7740 1 -- 172.21.15.81:0/3248912090 wait complete. 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a91f7740 20 client.5010 trim_cache size 0 max 16384 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:47:10.417 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 12, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "5b3b9278": { 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 12, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 140.5, 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:47:10.418 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:47:10.419 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 msgr2=0x7f948007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 0x7f948007a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f948c007fd0 tx=0x7f948c009040 comp rx=0 tx=0).stop 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 msgr2=0x7f94a00c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9490009980 tx=0x7f9490032b90 comp rx=0 tx=0).stop 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 shutdown_connections 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9480077f70 0x7f948007a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94a01555a0 0x7f94a01f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94a0152550 0x7f94a014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 --2- 172.21.15.81:0/35721986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a00c94b0 0x7f94a00c12a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:47:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.414+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 >> 172.21.15.81:0/35721986 conn(0x7f94a00c8990 msgr2=0x7f94a0072570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:47:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.415+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 shutdown_connections 2024-09-11T00:47:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:47:10.415+0000 7f94a4c00640 1 -- 172.21.15.81:0/35721986 wait complete. 2024-09-11T00:47:10.434 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5b3b9278', total seconds elapsed: 21.2 2024-09-11T00:47:12.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:12.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:42.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:47:42.256 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:12.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:12.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:26.578 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:48:26.578 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T00:48:26.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:48:26.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 -- 172.21.15.81:0/526499227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4015ad10 msgr2=0x7fee400d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 --2- 172.21.15.81:0/526499227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4015ad10 0x7fee400d0670 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee38005fd0 tx=0x7fee3802a940 comp rx=0 tx=0).stop 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 -- 172.21.15.81:0/526499227 shutdown_connections 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 --2- 172.21.15.81:0/526499227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4015ad10 0x7fee400d0670 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 --2- 172.21.15.81:0/526499227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee400cb1d0 0x7fee4015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 -- 172.21.15.81:0/526499227 >> 172.21.15.81:0/526499227 conn(0x7fee4006d570 msgr2=0x7fee4006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.749+0000 7fee45200640 1 -- 172.21.15.81:0/526499227 shutdown_connections 2024-09-11T00:48:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.750+0000 7fee45200640 1 -- 172.21.15.81:0/526499227 wait complete. 2024-09-11T00:48:26.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.751+0000 7fee45200640 1 Processor -- start 2024-09-11T00:48:26.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.751+0000 7fee45200640 1 -- start start 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee40154a10 0x7fee40150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4015ad10 0x7fee40153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee4015e780 con 0x7fee400cb1d0 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fee4015e4a0 con 0x7fee40154a10 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee45200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fee40154df0 con 0x7fee4015ad10 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.752+0000 7fee3de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50292/0 (socket says 172.21.15.81:50292) 2024-09-11T00:48:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 -- 172.21.15.81:0/52385715 learned_addr learned my addr 172.21.15.81:0/52385715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3d400640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee40154a10 0x7fee40150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3e800640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4015ad10 0x7fee40153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 -- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4015ad10 msgr2=0x7fee40153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4015ad10 0x7fee40153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 -- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee40154a10 msgr2=0x7fee40150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee40154a10 0x7fee40150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 -- 172.21.15.81:0/52385715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4014f730 con 0x7fee400cb1d0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.753+0000 7fee3de00640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c490 tx=0x7fee3000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.754+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30016020 con 0x7fee400cb1d0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.754+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee30012940 con 0x7fee400cb1d0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.754+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30012d90 con 0x7fee400cb1d0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.754+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4014f100 con 0x7fee400cb1d0 2024-09-11T00:48:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.754+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401f17f0 con 0x7fee400cb1d0 2024-09-11T00:48:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.755+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee400c7040 con 0x7fee400cb1d0 2024-09-11T00:48:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.756+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fee3001a3b0 con 0x7fee400cb1d0 2024-09-11T00:48:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.758+0000 7fee36000640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 0x7fee2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.758+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fee30099ff0 con 0x7fee400cb1d0 2024-09-11T00:48:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.758+0000 7fee3d400640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 0x7fee2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:26.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.759+0000 7fee3d400640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 0x7fee2007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee400ca630 tx=0x7fee2c00b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:26.762+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fee400c7040 con 0x7fee400cb1d0 2024-09-11T00:48:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.013+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee400cbe50 con 0x7fee400cb1d0 2024-09-11T00:48:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.014+0000 7fee36000640 1 -- 172.21.15.81:0/52385715 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fee30020030 con 0x7fee400cb1d0 2024-09-11T00:48:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:48:27.017 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:48:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:48:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 msgr2=0x7fee2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 0x7fee2007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee400ca630 tx=0x7fee2c00b390 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 msgr2=0x7fee4014ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c490 tx=0x7fee3000c950 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 shutdown_connections 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fee20077f70 0x7fee2007a430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fee4015ad10 0x7fee40153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee40154a10 0x7fee40150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 --2- 172.21.15.81:0/52385715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee400cb1d0 0x7fee4014ff20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 >> 172.21.15.81:0/52385715 conn(0x7fee4006d570 msgr2=0x7fee4014ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 shutdown_connections 2024-09-11T00:48:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.016+0000 7fee45200640 1 -- 172.21.15.81:0/52385715 wait complete. 2024-09-11T00:48:27.037 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T00:48:27.037 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T00:48:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 -- 172.21.15.81:0/3630776734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c0cc030 msgr2=0x7fc04c0c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 --2- 172.21.15.81:0/3630776734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c0cc030 0x7fc04c0c4f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc04c15b5a0 tx=0x7fc03802a610 comp rx=0 tx=0).stop 2024-09-11T00:48:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 -- 172.21.15.81:0/3630776734 shutdown_connections 2024-09-11T00:48:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 --2- 172.21.15.81:0/3630776734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c0cc030 0x7fc04c0c4f60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 -- 172.21.15.81:0/3630776734 >> 172.21.15.81:0/3630776734 conn(0x7fc04c0688e0 msgr2=0x7fc04c068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 -- 172.21.15.81:0/3630776734 shutdown_connections 2024-09-11T00:48:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.228+0000 7fc04be00640 1 -- 172.21.15.81:0/3630776734 wait complete. 2024-09-11T00:48:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.229+0000 7fc04be00640 1 Processor -- start 2024-09-11T00:48:27.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.230+0000 7fc04be00640 1 -- start start 2024-09-11T00:48:27.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.230+0000 7fc04be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc04c0c54a0 0x7fc04c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.230+0000 7fc04be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c154810 0x7fc04c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c15b0b0 con 0x7fc04c0cc030 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c0c5930 con 0x7fc04c0c54a0 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c15a500 con 0x7fc04c154810 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50298/0 (socket says 172.21.15.81:50298) 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 -- 172.21.15.81:0/3437352332 learned_addr learned my addr 172.21.15.81:0/3437352332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04aa00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc04c0c54a0 0x7fc04c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04b400640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c154810 0x7fc04c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 -- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c154810 msgr2=0x7fc04c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c154810 0x7fc04c150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 -- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc04c0c54a0 msgr2=0x7fc04c14cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc04c0c54a0 0x7fc04c14cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.231+0000 7fc04a000640 1 -- 172.21.15.81:0/3437352332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c1517a0 con 0x7fc04c0cc030 2024-09-11T00:48:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc04a000640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc038009940 tx=0x7fc0380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc043400640 1 -- 172.21.15.81:0/3437352332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380044e0 con 0x7fc04c0cc030 2024-09-11T00:48:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc043400640 1 -- 172.21.15.81:0/3437352332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc038005550 con 0x7fc04c0cc030 2024-09-11T00:48:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc043400640 1 -- 172.21.15.81:0/3437352332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038004a00 con 0x7fc04c0cc030 2024-09-11T00:48:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c0cdef0 con 0x7fc04c0cc030 2024-09-11T00:48:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.232+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c1e3f60 con 0x7fc04c0cc030 2024-09-11T00:48:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.235+0000 7fc043400640 1 -- 172.21.15.81:0/3437352332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc038004ba0 con 0x7fc04c0cc030 2024-09-11T00:48:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.236+0000 7fc054cd8740 1 Processor -- start 2024-09-11T00:48:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.236+0000 7fc054cd8740 1 -- start start 2024-09-11T00:48:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.236+0000 7fc043400640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 0x7fc02c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.236+0000 7fc043400640 1 -- 172.21.15.81:0/3437352332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc0380bb740 con 0x7fc04c0cc030 2024-09-11T00:48:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.236+0000 7fc04b400640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 0x7fc02c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa3e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa41dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564faa35b260 con 0x564faa3e90c0 2024-09-11T00:48:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564faa34a690 con 0x564faa3e27c0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x564faa34e4a0 con 0x564faa426ba0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa3e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:55062/0 (socket says 172.21.15.81:55062) 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 -- 172.21.15.81:0/2647354758 learned_addr learned my addr 172.21.15.81:0/2647354758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04b400640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 0x7fc02c07a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0b6440 tx=0x7fc044009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 -- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 msgr2=0x564faa41dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04b400640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa41dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa41dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 -- 172.21.15.81:0/2647354758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 msgr2=0x564faa3e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa3e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04aa00640 1 -- 172.21.15.81:0/2647354758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564faa124d80 con 0x564faa3e27c0 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04b400640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa41dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:48:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.237+0000 7fc04a000640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa3e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:48:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.238+0000 7fc04aa00640 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc03c001530 tx=0x7fc03c0019f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80968c68358a6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.238+0000 7fc037400640 1 -- 172.21.15.81:0/2647354758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c019070 con 0x564faa3e27c0 2024-09-11T00:48:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.238+0000 7fc037400640 1 -- 172.21.15.81:0/2647354758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc03c0050d0 con 0x564faa3e27c0 2024-09-11T00:48:27.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.238+0000 7fc037400640 1 -- 172.21.15.81:0/2647354758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00e740 con 0x564faa3e27c0 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 -- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 msgr2=0x564faa3e2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc03c001530 tx=0x7fc03c0019f0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 -- 172.21.15.81:0/2647354758 shutdown_connections 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa41dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa3e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 --2- 172.21.15.81:0/2647354758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e27c0 0x564faa3e2ba0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 -- 172.21.15.81:0/2647354758 >> 172.21.15.81:0/2647354758 conn(0x564faa3e4520 msgr2=0x564faa3e7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 -- 172.21.15.81:0/2647354758 shutdown_connections 2024-09-11T00:48:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.239+0000 7fc054cd8740 1 -- 172.21.15.81:0/2647354758 wait complete. 2024-09-11T00:48:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.240+0000 7fc054cd8740 1 -- start start 2024-09-11T00:48:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.240+0000 7fc054cd8740 1 Processor -- start 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa426ba0 0x564faa410c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa41ae70 0x564faa4111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564faa0bacc0 con 0x564faa3e90c0 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564faa2efe60 con 0x564faa426ba0 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x564faa3e8500 con 0x564faa41ae70 2024-09-11T00:48:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc054cd8740 10 client.0 _ll_register_callbacks cb 0x564faa2f6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.241+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50322/0 (socket says 172.21.15.81:50322) 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 -- 172.21.15.81:0/798721278 learned_addr learned my addr 172.21.15.81:0/798721278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04b400640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa41ae70 0x564faa4111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04a000640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa426ba0 0x564faa410c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 -- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa41ae70 msgr2=0x564faa4111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa41ae70 0x564faa4111a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 -- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa426ba0 msgr2=0x564faa410c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa426ba0 0x564faa410c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 -- 172.21.15.81:0/798721278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564faa185510 con 0x564faa3e90c0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc04aa00640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0054b0 tx=0x7fc03c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1939040579415c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.242+0000 7fc02be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c019040 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc03c0050d0 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc03c0069b0 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc03c029050 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 10 client.5031 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564faa089c20 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc03c0050d0 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc03c02c020 con 0x564faa3e90c0 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 10 client.5031 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 10 client.5031 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 20 client.5031 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa413350 0x564faa43c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 4 client.5031 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.243+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564faa35d1b0 con 0x564faa413350 2024-09-11T00:48:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.244+0000 7fc04a000640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa413350 0x564faa43c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.244+0000 7fc04a000640 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa413350 0x564faa43c6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ee7f91223be150 server_cookie=f4fa84900243cf0c in_seq=0 out_seq=0 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.244+0000 7fc02be00640 10 client.5031 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc02be00640 1 -- 172.21.15.81:0/798721278 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564faa35d1b0 con 0x564faa413350 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc02be00640 10 client.5031 handle_command_reply: tid=0 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 client.5031 shutdown 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 msgr2=0x564faa41c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0054b0 tx=0x7fc03c0054e0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 shutdown_connections 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa413350 0x564faa43c6d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa41ae70 0x564faa4111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc02be00640 0 client.5031 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa426ba0 0x564faa410c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 --2- 172.21.15.81:0/798721278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa3e90c0 0x564faa41c7a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.245+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 >> 172.21.15.81:0/798721278 conn(0x564faa3e27c0 msgr2=0x564faa3e86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.246+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 shutdown_connections 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.246+0000 7fc054cd8740 1 -- 172.21.15.81:0/798721278 wait complete. 2024-09-11T00:48:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.246+0000 7fc054cd8740 20 client.5031 trim_cache size 0 max 16384 2024-09-11T00:48:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.267+0000 7fc054cd8740 1 Processor -- start 2024-09-11T00:48:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.267+0000 7fc054cd8740 1 -- start start 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 0x564faa410800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa41ae70 0x564faa410d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1ff060 con 0x564faa426ba0 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1fdf40 con 0x564faa41ae70 2024-09-11T00:48:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c1f4780 con 0x564faa3e90c0 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc04b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc04b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50334/0 (socket says 172.21.15.81:50334) 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.268+0000 7fc04b400640 1 -- 172.21.15.81:0/634710617 learned_addr learned my addr 172.21.15.81:0/634710617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04a000640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa41ae70 0x564faa410d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04aa00640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 0x564faa410800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 -- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 msgr2=0x564faa410800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 0x564faa410800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 -- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa41ae70 msgr2=0x564faa410d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa41ae70 0x564faa410d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 -- 172.21.15.81:0/634710617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564faa4193e0 con 0x564faa426ba0 2024-09-11T00:48:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04aa00640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 0x564faa410800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc04b400640 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc04c14e7a0 tx=0x7fc044014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa565beb6e137bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.269+0000 7fc036a00640 1 -- 172.21.15.81:0/634710617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044022670 con 0x564faa426ba0 2024-09-11T00:48:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc036a00640 1 -- 172.21.15.81:0/634710617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc044027070 con 0x564faa426ba0 2024-09-11T00:48:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc036a00640 1 -- 172.21.15.81:0/634710617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044022b80 con 0x564faa426ba0 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 -- 172.21.15.81:0/634710617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 msgr2=0x564faa435c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc04c14e7a0 tx=0x7fc044014000 comp rx=0 tx=0).stop 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 -- 172.21.15.81:0/634710617 shutdown_connections 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa426ba0 0x564faa435c50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa41ae70 0x564faa410d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 --2- 172.21.15.81:0/634710617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa3e90c0 0x564faa410800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.270+0000 7fc054cd8740 1 -- 172.21.15.81:0/634710617 >> 172.21.15.81:0/634710617 conn(0x564faa3e27c0 msgr2=0x564faa3e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.271+0000 7fc054cd8740 1 -- 172.21.15.81:0/634710617 shutdown_connections 2024-09-11T00:48:27.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.271+0000 7fc054cd8740 1 -- 172.21.15.81:0/634710617 wait complete. 2024-09-11T00:48:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.271+0000 7fc054cd8740 1 -- start start 2024-09-11T00:48:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.271+0000 7fc054cd8740 1 Processor -- start 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.272+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e90c0 0x564faa3e1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa44bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1fcc50 con 0x564faa41ae70 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c1fd870 con 0x564faa3e90c0 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c1fd220 con 0x564faa426ba0 2024-09-11T00:48:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc054cd8740 10 client.0 _ll_register_callbacks cb 0x7fc03c0013b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50336/0 (socket says 172.21.15.81:50336) 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 -- 172.21.15.81:0/3819643247 learned_addr learned my addr 172.21.15.81:0/3819643247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04aa00640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e90c0 0x564faa3e1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04b400640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa44bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 -- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 msgr2=0x564faa44bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa44bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 -- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e90c0 msgr2=0x564faa3e1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e90c0 0x564faa3e1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04a000640 1 -- 172.21.15.81:0/3819643247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564faa3e1ea0 con 0x564faa41ae70 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.273+0000 7fc04b400640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa44bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc04a000640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc038083750 tx=0x7fc038086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cd4613b034def server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038049040 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc038083a20 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc044027070 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc0380832d0 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 10 client.5037 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564faa4a0d70 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc044027070 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc03808c830 con 0x564faa41ae70 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 10 client.5037 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 10 client.5037 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 20 client.5037 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa3e7ed0 0x564faa44c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 4 client.5037 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T00:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.274+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x564faa358c60 con 0x564faa3e7ed0 2024-09-11T00:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.275+0000 7fc04aa00640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa3e7ed0 0x564faa44c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.275+0000 7fc02be00640 10 client.5037 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.275+0000 7fc04aa00640 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa3e7ed0 0x564faa44c270 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6498b56b39348db server_cookie=c968c11e531d8bc1 in_seq=0 out_seq=0 2024-09-11T00:48:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc02be00640 1 -- 172.21.15.81:0/3819643247 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564faa358c60 con 0x564faa3e7ed0 2024-09-11T00:48:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc02be00640 10 client.5037 handle_command_reply: tid=0 2024-09-11T00:48:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 client.5037 shutdown 2024-09-11T00:48:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 msgr2=0x564faa4a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc038083750 tx=0x7fc038086040 comp rx=0 tx=0).stop 2024-09-11T00:48:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 shutdown_connections 2024-09-11T00:48:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564faa3e7ed0 0x564faa44c270 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564faa426ba0 0x564faa44bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564faa41ae70 0x564faa4a07d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 --2- 172.21.15.81:0/3819643247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564faa3e90c0 0x564faa3e1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 >> 172.21.15.81:0/3819643247 conn(0x564faa3e27c0 msgr2=0x564faa3e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc02be00640 0 client.5037 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 shutdown_connections 2024-09-11T00:48:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 1 -- 172.21.15.81:0/3819643247 wait complete. 2024-09-11T00:48:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc054cd8740 20 client.5037 trim_cache size 0 max 16384 2024-09-11T00:48:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 14, 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "8f2b5e1e": { 2024-09-11T00:48:27.351 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 14, 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:48:27.352 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:27.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:48:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 msgr2=0x7fc02c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 0x7fc02c07a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0b6440 tx=0x7fc044009040 comp rx=0 tx=0).stop 2024-09-11T00:48:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 msgr2=0x7fc04c14d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc038009940 tx=0x7fc0380042f0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 shutdown_connections 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc02c077f70 0x7fc02c07a430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc04c154810 0x7fc04c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c0cc030 0x7fc04c14d520 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 --2- 172.21.15.81:0/3437352332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc04c0c54a0 0x7fc04c14cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 >> 172.21.15.81:0/3437352332 conn(0x7fc04c0688e0 msgr2=0x7fc04c152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.343+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 shutdown_connections 2024-09-11T00:48:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:27.344+0000 7fc04be00640 1 -- 172.21.15.81:0/3437352332 wait complete. 2024-09-11T00:48:27.361 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8f2b5e1e', quiesce took 0.8 seconds. Will release after: 29.2 2024-09-11T00:48:42.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:42.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:48:56.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:48:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 -- 172.21.15.81:0/3139853323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 msgr2=0x7f4cd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3139853323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cd4004c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009b50 tx=0x7f4cd4005830 comp rx=0 tx=0).stop 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 -- 172.21.15.81:0/3139853323 shutdown_connections 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3139853323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cd4004c80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 -- 172.21.15.81:0/3139853323 >> 172.21.15.81:0/3139853323 conn(0x7f4cec0700f0 msgr2=0x7f4cec070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 -- 172.21.15.81:0/3139853323 shutdown_connections 2024-09-11T00:48:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.729+0000 7f4cf4200640 1 -- 172.21.15.81:0/3139853323 wait complete. 2024-09-11T00:48:56.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.730+0000 7f4cf4200640 1 Processor -- start 2024-09-11T00:48:56.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.731+0000 7f4cf4200640 1 -- start start 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cec153eb0 0x7f4cec1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cec1532a0 0x7f4cec1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec070cf0 con 0x7f4cd4004800 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec15c140 con 0x7f4cec1532a0 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf4200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec1529f0 con 0x7f4cec153eb0 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:56.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45890/0 (socket says 172.21.15.81:45890) 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 -- 172.21.15.81:0/3828149215 learned_addr learned my addr 172.21.15.81:0/3828149215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf0e00640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cec153eb0 0x7f4cec1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf2200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cec1532a0 0x7f4cec1f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 -- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cec153eb0 msgr2=0x7f4cec1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cec153eb0 0x7f4cec1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 -- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cec1532a0 msgr2=0x7f4cec1f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cec1532a0 0x7f4cec1f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.732+0000 7f4cf1800640 1 -- 172.21.15.81:0/3828149215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec1f4af0 con 0x7f4cd4004800 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4cf1800640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00018c0 tx=0x7f4ce0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:56.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0015070 con 0x7f4cd4004800 2024-09-11T00:48:56.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ce000ebb0 con 0x7f4cd4004800 2024-09-11T00:48:56.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00020c0 con 0x7f4cd4004800 2024-09-11T00:48:56.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cec15b360 con 0x7f4cd4004800 2024-09-11T00:48:56.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.733+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cec153990 con 0x7f4cd4004800 2024-09-11T00:48:56.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.734+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cec15b880 con 0x7f4cd4004800 2024-09-11T00:48:56.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.735+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ce0011460 con 0x7f4cd4004800 2024-09-11T00:48:56.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.737+0000 7f4ce9600640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 0x7f4ccc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:56.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.737+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4ce009acc0 con 0x7f4cd4004800 2024-09-11T00:48:56.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.737+0000 7f4cf0e00640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 0x7f4ccc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:56.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.738+0000 7f4cf0e00640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 0x7f4ccc07a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8035000 tx=0x7f4cd80046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:56.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.741+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ce00633b0 con 0x7f4cd4004800 2024-09-11T00:48:56.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.958+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cec0c2ea0 con 0x7f4cd4004800 2024-09-11T00:48:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.959+0000 7f4ce9600640 1 -- 172.21.15.81:0/3828149215 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f4ce0062cb0 con 0x7f4cd4004800 2024-09-11T00:48:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:48:56.962 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:48:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:48:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 msgr2=0x7f4ccc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 0x7f4ccc07a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8035000 tx=0x7f4cd80046c0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 msgr2=0x7f4cec1549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00018c0 tx=0x7f4ce0001d80 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 shutdown_connections 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4ccc077fa0 0x7f4ccc07a460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cec1532a0 0x7f4cec1f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cec153eb0 0x7f4cec1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 --2- 172.21.15.81:0/3828149215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd4004800 0x7f4cec1549c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 >> 172.21.15.81:0/3828149215 conn(0x7f4cec0700f0 msgr2=0x7f4cec1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 shutdown_connections 2024-09-11T00:48:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:56.961+0000 7f4cf4200640 1 -- 172.21.15.81:0/3828149215 wait complete. 2024-09-11T00:48:56.979 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 8f2b5e1e --release --await' 2024-09-11T00:48:56.979 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 8f2b5e1e --release --await 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 -- 172.21.15.81:0/3724935993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc06f760 msgr2=0x7fbadc070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 --2- 172.21.15.81:0/3724935993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc06f760 0x7fbadc070c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbadc070b40 tx=0x7fbad002a560 comp rx=0 tx=0).stop 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 -- 172.21.15.81:0/3724935993 shutdown_connections 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 --2- 172.21.15.81:0/3724935993 >> v2:172.21.15.167:3300/0 conn(0x7fbadc15baa0 0x7fbadc15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 --2- 172.21.15.81:0/3724935993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc0c7360 0x7fbadc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 --2- 172.21.15.81:0/3724935993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc06f760 0x7fbadc070c40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 -- 172.21.15.81:0/3724935993 >> 172.21.15.81:0/3724935993 conn(0x7fbadc06ff90 msgr2=0x7fbadc0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.140+0000 7fbae4800640 1 -- 172.21.15.81:0/3724935993 shutdown_connections 2024-09-11T00:48:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.141+0000 7fbae4800640 1 -- 172.21.15.81:0/3724935993 wait complete. 2024-09-11T00:48:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.142+0000 7fbae4800640 1 Processor -- start 2024-09-11T00:48:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.142+0000 7fbae4800640 1 -- start start 2024-09-11T00:48:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 0x7fbadc1e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c7360 0x7fbadc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 0x7fbadc14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc074db0 con 0x7fbadc15baa0 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc074ad0 con 0x7fbadc0c7360 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae4800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc0c6e40 con 0x7fbadc06f760 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae1e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 0x7fbadc1e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.143+0000 7fbae2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 0x7fbadc14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae1e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 0x7fbadc1e5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:40370/0 (socket says 172.21.15.81:40370) 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae1e00640 1 -- 172.21.15.81:0/1744961897 learned_addr learned my addr 172.21.15.81:0/1744961897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae1400640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c7360 0x7fbadc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 -- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 msgr2=0x7fbadc1e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 0x7fbadc1e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 -- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c7360 msgr2=0x7fbadc0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c7360 0x7fbadc0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 -- 172.21.15.81:0/1744961897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc152ff0 con 0x7fbadc15baa0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbae2800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 0x7fbadc14e660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbad800e960 tx=0x7fbad800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.144+0000 7fbad6000640 1 -- 172.21.15.81:0/1744961897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8004d20 con 0x7fbadc15baa0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.145+0000 7fbad6000640 1 -- 172.21.15.81:0/1744961897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbad800ca60 con 0x7fbadc15baa0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.145+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc0aeb10 con 0x7fbadc15baa0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.145+0000 7fbad6000640 1 -- 172.21.15.81:0/1744961897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8005020 con 0x7fbadc15baa0 2024-09-11T00:48:57.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.145+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc15a7f0 con 0x7fbadc15baa0 2024-09-11T00:48:57.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.148+0000 7fbad6000640 1 -- 172.21.15.81:0/1744961897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbad800f040 con 0x7fbadc15baa0 2024-09-11T00:48:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.149+0000 7fbad6000640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 0x7fbac007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.149+0000 7fbad6000640 1 -- 172.21.15.81:0/1744961897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbad809a5a0 con 0x7fbadc15baa0 2024-09-11T00:48:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.149+0000 7fbae77be740 1 Processor -- start 2024-09-11T00:48:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.149+0000 7fbae77be740 1 -- start start 2024-09-11T00:48:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.149+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 0x7fbac007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 0x7fbac007a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009230 tx=0x7fbad0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b0910 0x55e0267eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e026728370 con 0x55e0267b3b80 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e0267177a0 con 0x55e0267f5810 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e02671b5b0 con 0x55e0267b0910 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45930/0 (socket says 172.21.15.81:45930) 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1e00640 1 -- 172.21.15.81:0/1538121769 learned_addr learned my addr 172.21.15.81:0/1538121769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae2800640 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b0910 0x55e0267eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1400640 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.150+0000 7fbae1e00640 1 -- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b0910 msgr2=0x55e0267eb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b0910 0x55e0267eb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbae1e00640 1 -- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 msgr2=0x55e0267eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbae1e00640 1 -- 172.21.15.81:0/1538121769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0266b0010 con 0x55e0267b3b80 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbad0005fd0 tx=0x7fbad003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f32b2ccf627fe81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbaca600640 1 -- 172.21.15.81:0/1538121769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0035040 con 0x55e0267b3b80 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbaca600640 1 -- 172.21.15.81:0/1538121769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbad004e070 con 0x55e0267b3b80 2024-09-11T00:48:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.151+0000 7fbaca600640 1 -- 172.21.15.81:0/1538121769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad00496e0 con 0x55e0267b3b80 2024-09-11T00:48:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 -- 172.21.15.81:0/1538121769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 msgr2=0x55e0267fec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbad0005fd0 tx=0x7fbad003d000 comp rx=0 tx=0).stop 2024-09-11T00:48:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 -- 172.21.15.81:0/1538121769 shutdown_connections 2024-09-11T00:48:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b0910 0x55e0267eb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 --2- 172.21.15.81:0/1538121769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267b3b80 0x55e0267fec20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 -- 172.21.15.81:0/1538121769 >> 172.21.15.81:0/1538121769 conn(0x55e0267b1d60 msgr2=0x55e0267b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 -- 172.21.15.81:0/1538121769 shutdown_connections 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.152+0000 7fbae77be740 1 -- 172.21.15.81:0/1538121769 wait complete. 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.153+0000 7fbae77be740 1 -- start start 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.153+0000 7fbae77be740 1 Processor -- start 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b3b80 0x55e0267ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e0266bef70 con 0x55e026805ae0 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e0266bd090 con 0x55e0267f5810 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e0268061b0 con 0x55e0267b3b80 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae77be740 10 client.0 _ll_register_callbacks cb 0x55e026426110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45938/0 (socket says 172.21.15.81:45938) 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 -- 172.21.15.81:0/610714832 learned_addr learned my addr 172.21.15.81:0/610714832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae1e00640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b3b80 0x55e0267ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae1400640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 -- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b3b80 msgr2=0x55e0267ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b3b80 0x55e0267ee2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 -- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 msgr2=0x55e0267eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae2800640 1 -- 172.21.15.81:0/610714832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e026479ea0 con 0x55e026805ae0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.154+0000 7fbae1400640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae2800640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbad8098750 tx=0x7fbad8062cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4e06a1b9f39510 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8088070 con 0x55e026805ae0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad004e070 con 0x55e026805ae0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbad8088210 con 0x55e026805ae0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbad801f040 con 0x55e026805ae0 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 10 client.5055 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e0264f2d30 con 0x55e026805ae0 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbad004e070 con 0x55e026805ae0 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbad8069300 con 0x55e026805ae0 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 10 client.5055 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 10 client.5055 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 20 client.5055 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267f2c00 0x55e0267e9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 4 client.5055 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.155+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e02672a2c0 con 0x55e0267f2c00 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.156+0000 7fbae1e00640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267f2c00 0x55e0267e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.156+0000 7fbae1e00640 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267f2c00 0x55e0267e9540 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a6218a492f912d4 server_cookie=63c3cf4189aa1c03 in_seq=0 out_seq=0 2024-09-11T00:48:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.156+0000 7fbabea00640 10 client.5055 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.157+0000 7fbabea00640 1 -- 172.21.15.81:0/610714832 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e02672a2c0 con 0x55e0267f2c00 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.157+0000 7fbabea00640 10 client.5055 handle_command_reply: tid=0 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.157+0000 7fbae77be740 1 client.5055 shutdown 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 msgr2=0x55e0267ef320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbad8098750 tx=0x7fbad8062cf0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 shutdown_connections 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267f2c00 0x55e0267e9540 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026805ae0 0x55e0267ef320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267f5810 0x55e0267eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 --2- 172.21.15.81:0/610714832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267b3b80 0x55e0267ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbabea00640 0 client.5055 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 >> 172.21.15.81:0/610714832 conn(0x55e0267b0910 msgr2=0x55e0267b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 shutdown_connections 2024-09-11T00:48:57.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 1 -- 172.21.15.81:0/610714832 wait complete. 2024-09-11T00:48:57.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.158+0000 7fbae77be740 20 client.5055 trim_cache size 0 max 16384 2024-09-11T00:48:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.176+0000 7fbae77be740 1 Processor -- start 2024-09-11T00:48:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.176+0000 7fbae77be740 1 -- start start 2024-09-11T00:48:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.176+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e026819c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.176+0000 7fbae77be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.176+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e026803080 0x55e0267ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae77be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1ff2b0 con 0x55e0267f5810 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1fe190 con 0x55e0267b3b80 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc159f80 con 0x55e026803080 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45950/0 (socket says 172.21.15.81:45950) 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 -- 172.21.15.81:0/3076347037 learned_addr learned my addr 172.21.15.81:0/3076347037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae2800640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e026803080 0x55e0267ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1e00640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e026819c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 -- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e026803080 msgr2=0x55e0267ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e026803080 0x55e0267ee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 -- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 msgr2=0x55e026819c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e026819c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 -- 172.21.15.81:0/3076347037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0267e98b0 con 0x55e0267f5810 2024-09-11T00:48:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1e00640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e026819c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:48:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.177+0000 7fbae1400640 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbadc1e42c0 tx=0x7fbacc00bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d595f4257bfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbac9c00640 1 -- 172.21.15.81:0/3076347037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc003d20 con 0x55e0267f5810 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbac9c00640 1 -- 172.21.15.81:0/3076347037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbacc00be10 con 0x55e0267f5810 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbac9c00640 1 -- 172.21.15.81:0/3076347037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc005260 con 0x55e0267f5810 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 -- 172.21.15.81:0/3076347037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 msgr2=0x55e026802b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbadc1e42c0 tx=0x7fbacc00bb60 comp rx=0 tx=0).stop 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 -- 172.21.15.81:0/3076347037 shutdown_connections 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e026803080 0x55e0267ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0267f5810 0x55e026802b40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 --2- 172.21.15.81:0/3076347037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e026819c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 -- 172.21.15.81:0/3076347037 >> 172.21.15.81:0/3076347037 conn(0x55e0267b0910 msgr2=0x55e0267aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 -- 172.21.15.81:0/3076347037 shutdown_connections 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.178+0000 7fbae77be740 1 -- 172.21.15.81:0/3076347037 wait complete. 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.179+0000 7fbae77be740 1 -- start start 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.179+0000 7fbae77be740 1 Processor -- start 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e0267e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 0x55e026871350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1fd470 con 0x55e026803080 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1fdb00 con 0x55e0267b3b80 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e0267ea900 con 0x55e0267f5810 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae77be740 10 client.0 _ll_register_callbacks cb 0x7fbad805e600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45960/0 (socket says 172.21.15.81:45960) 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae2800640 1 -- 172.21.15.81:0/1783260722 learned_addr learned my addr 172.21.15.81:0/1783260722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e0267e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.180+0000 7fbae1400640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 0x55e026871350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 -- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 msgr2=0x55e026871350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 0x55e026871350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 -- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 msgr2=0x55e0267e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e0267e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 -- 172.21.15.81:0/1783260722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e026871dd0 con 0x55e026803080 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae1400640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 0x55e026871350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae2800640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbad8093040 tx=0x7fbad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04a72a28e310c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8088040 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbad8098370 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbacc00be10 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbad8084050 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae77be740 10 client.5061 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e026802c70 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbacc00be10 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.181+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbad8098050 con 0x55e026803080 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 10 client.5061 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 10 client.5061 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 20 client.5061 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267afbb0 0x55e026877630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 4 client.5061 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8f2b5e1e", "release": true, "await": true}] 2024-09-11T00:48:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8f2b5e1e", "release": true, "await": true}) -- 0x55e026725d70 con 0x55e0267afbb0 2024-09-11T00:48:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.182+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267afbb0 0x55e026877630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.183+0000 7fbae1e00640 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267afbb0 0x55e026877630 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98577b9f4d8ec26a server_cookie=553a64bf84707be0 in_seq=0 out_seq=0 2024-09-11T00:48:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.183+0000 7fbabea00640 10 client.5061 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbabea00640 1 -- 172.21.15.81:0/1783260722 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e026725d70 con 0x55e0267afbb0 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbabea00640 10 client.5061 handle_command_reply: tid=0 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 client.5061 shutdown 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 msgr2=0x55e026871890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbad8093040 tx=0x7fbad8004a40 comp rx=0 tx=0).stop 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 shutdown_connections 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e0267afbb0 0x55e026877630 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e026803080 0x55e026871890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e0267f5810 0x55e026871350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 --2- 172.21.15.81:0/1783260722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e0267b3b80 0x55e0267e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbabea00640 0 client.5061 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 >> 172.21.15.81:0/1783260722 conn(0x55e0267b0910 msgr2=0x55e0267aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 shutdown_connections 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 1 -- 172.21.15.81:0/1783260722 wait complete. 2024-09-11T00:48:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.211+0000 7fbae77be740 20 client.5061 trim_cache size 0 max 16384 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 16, 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "8f2b5e1e": { 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 16, 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:57.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:57.217 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:48:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 msgr2=0x7fbac007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 0x7fbac007a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009230 tx=0x7fbad0004730 comp rx=0 tx=0).stop 2024-09-11T00:48:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 msgr2=0x7fbadc14e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 0x7fbadc14e660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbad800e960 tx=0x7fbad800ed60 comp rx=0 tx=0).stop 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 shutdown_connections 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbac0077f70 0x7fbac007a430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc15baa0 0x7fbadc14e660 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c7360 0x7fbadc0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 --2- 172.21.15.81:0/1744961897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbadc06f760 0x7fbadc1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 >> 172.21.15.81:0/1744961897 conn(0x7fbadc06ff90 msgr2=0x7fbadc0c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 shutdown_connections 2024-09-11T00:48:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.212+0000 7fbae4800640 1 -- 172.21.15.81:0/1744961897 wait complete. 2024-09-11T00:48:57.230 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8f2b5e1e', total seconds elapsed: 30.7 2024-09-11T00:48:57.230 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T00:48:57.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:48:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.407+0000 7f8681000640 1 -- 172.21.15.81:0/304349363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 msgr2=0x7f867c15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.407+0000 7f8681000640 1 --2- 172.21.15.81:0/304349363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c15ba70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f867c0c9760 tx=0x7f867402aa30 comp rx=0 tx=0).stop 2024-09-11T00:48:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 -- 172.21.15.81:0/304349363 shutdown_connections 2024-09-11T00:48:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 --2- 172.21.15.81:0/304349363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c15ba70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 --2- 172.21.15.81:0/304349363 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 --2- 172.21.15.81:0/304349363 >> v2:172.21.15.167:3300/0 conn(0x7f867c14ebc0 0x7f867c06d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 -- 172.21.15.81:0/304349363 >> 172.21.15.81:0/304349363 conn(0x7f867c06ffd0 msgr2=0x7f867c0703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 -- 172.21.15.81:0/304349363 shutdown_connections 2024-09-11T00:48:57.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.408+0000 7f8681000640 1 -- 172.21.15.81:0/304349363 wait complete. 2024-09-11T00:48:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.410+0000 7f8681000640 1 Processor -- start 2024-09-11T00:48:57.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.410+0000 7f8681000640 1 -- start start 2024-09-11T00:48:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f867c14ebc0 0x7f867c073500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0c7040 con 0x7f867c074b30 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f867c1581a0 con 0x7f867c14ebc0 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f8681000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f867c14efa0 con 0x7f867c0b1f10 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45978/0 (socket says 172.21.15.81:45978) 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f867c14ebc0 0x7f867c073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 -- 172.21.15.81:0/1719911578 learned_addr learned my addr 172.21.15.81:0/1719911578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867aa00640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 -- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 msgr2=0x7f867c0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 -- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f867c14ebc0 msgr2=0x7f867c073500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f867c14ebc0 0x7f867c073500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867b400640 1 -- 172.21.15.81:0/1719911578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c1f0530 con 0x7f867c074b30 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.411+0000 7f867aa00640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f867b400640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d770 tx=0x7f866c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c017070 con 0x7f867c074b30 2024-09-11T00:48:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f866c009d20 con 0x7f867c074b30 2024-09-11T00:48:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0106c0 con 0x7f867c074b30 2024-09-11T00:48:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c072760 con 0x7f867c074b30 2024-09-11T00:48:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.412+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c072d20 con 0x7f867c074b30 2024-09-11T00:48:57.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.413+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0745f0 con 0x7f867c074b30 2024-09-11T00:48:57.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.415+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f866c010860 con 0x7f867c074b30 2024-09-11T00:48:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.416+0000 7f8673400640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 0x7f865c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.416+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f866c09a480 con 0x7f867c074b30 2024-09-11T00:48:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.416+0000 7f867aa00640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 0x7f865c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.417+0000 7f867aa00640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 0x7f865c07a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86680058c0 tx=0x7f8668005850 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.420+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f866c062520 con 0x7f867c074b30 2024-09-11T00:48:57.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.702+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f867c072480 con 0x7f867c074b30 2024-09-11T00:48:57.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.703+0000 7f8673400640 1 -- 172.21.15.81:0/1719911578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f866c066f50 con 0x7f867c074b30 2024-09-11T00:48:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:48:57.705 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:48:57.705 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 msgr2=0x7f865c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 0x7f865c07a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86680058c0 tx=0x7f8668005850 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 msgr2=0x7f867c0c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d770 tx=0x7f866c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 shutdown_connections 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f865c077f70 0x7f865c07a430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f867c14ebc0 0x7f867c073500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f867c0b1f10 0x7f867c0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 --2- 172.21.15.81:0/1719911578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c074b30 0x7f867c0c4600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 >> 172.21.15.81:0/1719911578 conn(0x7f867c06ffd0 msgr2=0x7f867c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 shutdown_connections 2024-09-11T00:48:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.705+0000 7f8681000640 1 -- 172.21.15.81:0/1719911578 wait complete. 2024-09-11T00:48:57.726 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T00:48:57.726 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 -- 172.21.15.81:0/3271215221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c141524f0 msgr2=0x7f1c140b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 --2- 172.21.15.81:0/3271215221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c141524f0 0x7f1c140b3e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009830 tx=0x7f1c0402a510 comp rx=0 tx=0).stop 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 -- 172.21.15.81:0/3271215221 shutdown_connections 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 --2- 172.21.15.81:0/3271215221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c140c9480 0x7f1c1415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 --2- 172.21.15.81:0/3271215221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c141524f0 0x7f1c140b3e30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 -- 172.21.15.81:0/3271215221 >> 172.21.15.81:0/3271215221 conn(0x7f1c1406c9e0 msgr2=0x7f1c1406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 -- 172.21.15.81:0/3271215221 shutdown_connections 2024-09-11T00:48:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.908+0000 7f1c19400640 1 -- 172.21.15.81:0/3271215221 wait complete. 2024-09-11T00:48:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.910+0000 7f1c19400640 1 Processor -- start 2024-09-11T00:48:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.910+0000 7f1c19400640 1 -- start start 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 0x7f1c1414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c141524f0 0x7f1c140c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c140cb710 con 0x7f1c141528d0 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c140b4370 con 0x7f1c140c9480 2024-09-11T00:48:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c19400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c140cb890 con 0x7f1c141524f0 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.911+0000 7f1c13200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c12800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 0x7f1c1414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45984/0 (socket says 172.21.15.81:45984) 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 -- 172.21.15.81:0/4269539471 learned_addr learned my addr 172.21.15.81:0/4269539471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c11e00640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c141524f0 0x7f1c140c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 -- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c141524f0 msgr2=0x7f1c140c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c141524f0 0x7f1c140c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 -- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 msgr2=0x7f1c1414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 0x7f1c1414c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 -- 172.21.15.81:0/4269539471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c140c7300 con 0x7f1c141528d0 2024-09-11T00:48:57.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c12800640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 0x7f1c1414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.912+0000 7f1c13200640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009cf0 tx=0x7f1c0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.913+0000 7f1c0aa00640 1 -- 172.21.15.81:0/4269539471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c003b70 con 0x7f1c141528d0 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.913+0000 7f1c0aa00640 1 -- 172.21.15.81:0/4269539471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c0c003e00 con 0x7f1c141528d0 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.913+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c140c75c0 con 0x7f1c141528d0 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.913+0000 7f1c0aa00640 1 -- 172.21.15.81:0/4269539471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c004280 con 0x7f1c141528d0 2024-09-11T00:48:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.913+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1415b3a0 con 0x7f1c141528d0 2024-09-11T00:48:57.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.916+0000 7f1c0aa00640 1 -- 172.21.15.81:0/4269539471 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1c0c004420 con 0x7f1c141528d0 2024-09-11T00:48:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.917+0000 7f1c1c3db740 1 Processor -- start 2024-09-11T00:48:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.917+0000 7f1c1c3db740 1 -- start start 2024-09-11T00:48:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.917+0000 7f1c0aa00640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 0x7f1bf407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.917+0000 7f1c0aa00640 1 -- 172.21.15.81:0/4269539471 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1c0c09af40 con 0x7f1c141528d0 2024-09-11T00:48:57.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c11e00640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 0x7f1bf407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 0x55d62bedd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf18b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d62be56260 con 0x55d62bee3f10 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d62be45690 con 0x55d62bedd610 2024-09-11T00:48:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55d62be494a0 con 0x55d62bf219f0 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c11e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c12800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 0x55d62bedd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c11e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45990/0 (socket says 172.21.15.81:45990) 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c11e00640 1 -- 172.21.15.81:0/2423469418 learned_addr learned my addr 172.21.15.81:0/2423469418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.918+0000 7f1c13200640 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf18b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 0x7f1bf407a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c00007fd0 tx=0x7f1c00001c30 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 -- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 msgr2=0x55d62bf18b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf18b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 -- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 msgr2=0x55d62bedd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 0x55d62bedd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 -- 172.21.15.81:0/2423469418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62bc1fd80 con 0x55d62bee3f10 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c12800640 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 0x55d62bedd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:48:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1c11e00640 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000fa30 tx=0x7f1c0001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0ac62eb289c43e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1bff000640 1 -- 172.21.15.81:0/2423469418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0001c040 con 0x55d62bee3f10 2024-09-11T00:48:57.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1bff000640 1 -- 172.21.15.81:0/2423469418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c00016ac0 con 0x55d62bee3f10 2024-09-11T00:48:57.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.919+0000 7f1bff000640 1 -- 172.21.15.81:0/2423469418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00016c70 con 0x55d62bee3f10 2024-09-11T00:48:57.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 -- 172.21.15.81:0/2423469418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 msgr2=0x55d62bee4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000fa30 tx=0x7f1c0001a000 comp rx=0 tx=0).stop 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 -- 172.21.15.81:0/2423469418 shutdown_connections 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf18b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bee4650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/2423469418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bedd610 0x55d62bedd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 -- 172.21.15.81:0/2423469418 >> 172.21.15.81:0/2423469418 conn(0x55d62bedf370 msgr2=0x55d62bee2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 -- 172.21.15.81:0/2423469418 shutdown_connections 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.920+0000 7f1c1c3db740 1 -- 172.21.15.81:0/2423469418 wait complete. 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.921+0000 7f1c1c3db740 1 -- start start 2024-09-11T00:48:57.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.922+0000 7f1c1c3db740 1 Processor -- start 2024-09-11T00:48:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf1dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf201e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d62bbb5cc0 con 0x55d62bf219f0 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d62bdeae60 con 0x55d62bee3f10 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55d62bee3350 con 0x55d62bf1f220 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c1c3db740 10 client.0 _ll_register_callbacks cb 0x55d62bdf1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c11e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c11e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45992/0 (socket says 172.21.15.81:45992) 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c11e00640 1 -- 172.21.15.81:0/227721566 learned_addr learned my addr 172.21.15.81:0/227721566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c12800640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf1dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.923+0000 7f1c13200640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 -- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 msgr2=0x55d62bf201e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf201e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 -- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 msgr2=0x55d62bf1dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf1dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 -- 172.21.15.81:0/227721566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bc80510 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c13200640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c11e00640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c00020660 tx=0x7f1c00020690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fbaa6c84f78da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1bf3400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0002d030 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c00016ac0 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.924+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1c00025050 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1c00039050 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 10 client.5079 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d62bb84c20 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c00016ac0 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1c0003c020 con 0x55d62bf219f0 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 10 client.5079 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 10 client.5079 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 20 client.5079 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bf0aa90 0x55d62bf373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 4 client.5079 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:48:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.925+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d62be581b0 con 0x55d62bf0aa90 2024-09-11T00:48:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.926+0000 7f1c12800640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bf0aa90 0x55d62bf373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.926+0000 7f1c12800640 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bf0aa90 0x55d62bf373a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8888e2e203ad92ec server_cookie=50ea0227a2c02f83 in_seq=0 out_seq=0 2024-09-11T00:48:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.926+0000 7f1bf3400640 10 client.5079 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1bf3400640 1 -- 172.21.15.81:0/227721566 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d62be581b0 con 0x55d62bf0aa90 2024-09-11T00:48:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1bf3400640 10 client.5079 handle_command_reply: tid=0 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 client.5079 shutdown 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 msgr2=0x55d62bf0c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1c00020660 tx=0x7f1c00020690 comp rx=0 tx=0).stop 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 shutdown_connections 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bf0aa90 0x55d62bf373a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.927+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf0c4e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/227721566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 >> 172.21.15.81:0/227721566 conn(0x55d62bedd610 msgr2=0x55d62bedc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1bf3400640 0 client.5079 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 shutdown_connections 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1c1c3db740 1 -- 172.21.15.81:0/227721566 wait complete. 2024-09-11T00:48:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.928+0000 7f1c1c3db740 20 client.5079 trim_cache size 0 max 16384 2024-09-11T00:48:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.947+0000 7f1c1c3db740 1 Processor -- start 2024-09-11T00:48:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.947+0000 7f1c1c3db740 1 -- start start 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 0x55d62bf0d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf47a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141ff250 con 0x55d62bee3f10 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141fe130 con 0x55d62bf1f220 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c141f48d0 con 0x55d62bf219f0 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45998/0 (socket says 172.21.15.81:45998) 2024-09-11T00:48:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 -- 172.21.15.81:0/3108997175 learned_addr learned my addr 172.21.15.81:0/3108997175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c11e00640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 0x55d62bf0d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c13200640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf47a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 -- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 msgr2=0x55d62bf47a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf47a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 -- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 msgr2=0x55d62bf0d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 0x55d62bf0d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c12800640 1 -- 172.21.15.81:0/3108997175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62bf18410 con 0x55d62bee3f10 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.948+0000 7f1c11e00640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 0x55d62bf0d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.949+0000 7f1c12800640 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c0402ab00 tx=0x7f1c04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856ef3b358c95f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.949+0000 7f1bfe600640 1 -- 172.21.15.81:0/3108997175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0404b070 con 0x55d62bee3f10 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.949+0000 7f1bfe600640 1 -- 172.21.15.81:0/3108997175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c04003c10 con 0x55d62bee3f10 2024-09-11T00:48:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.949+0000 7f1bfe600640 1 -- 172.21.15.81:0/3108997175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04005020 con 0x55d62bee3f10 2024-09-11T00:48:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 -- 172.21.15.81:0/3108997175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 msgr2=0x55d62bf0cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1c0402ab00 tx=0x7f1c04004730 comp rx=0 tx=0).stop 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 -- 172.21.15.81:0/3108997175 shutdown_connections 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf219f0 0x55d62bf47a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bf1f220 0x55d62bf0d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/3108997175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bee3f10 0x55d62bf0cb40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 -- 172.21.15.81:0/3108997175 >> 172.21.15.81:0/3108997175 conn(0x55d62bedd610 msgr2=0x55d62bf0c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 -- 172.21.15.81:0/3108997175 shutdown_connections 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.950+0000 7f1c1c3db740 1 -- 172.21.15.81:0/3108997175 wait complete. 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.951+0000 7f1c1c3db740 1 -- start start 2024-09-11T00:48:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.951+0000 7f1c1c3db740 1 Processor -- start 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf9eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf06f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141fcd80 con 0x55d62bf219f0 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141fda60 con 0x55d62bee3f10 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c141fd3d0 con 0x55d62bf1f220 2024-09-11T00:48:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c1c3db740 10 client.0 _ll_register_callbacks cb 0x7f1c0000f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c13200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c13200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46012/0 (socket says 172.21.15.81:46012) 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.952+0000 7f1c13200640 1 -- 172.21.15.81:0/1782595796 learned_addr learned my addr 172.21.15.81:0/1782595796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c12800640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf9eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c11e00640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf06f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 -- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 msgr2=0x55d62bf06f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf06f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 -- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 msgr2=0x55d62bf9eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:48:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf9eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 -- 172.21.15.81:0/1782595796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bf1cf90 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c12800640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf9eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c13200640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00efd0 tx=0x7f1c0c062760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2dcd89536c1e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1bf3400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c087050 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1c0c083340 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c04003c10 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1c0c098050 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c1c3db740 10 client.5085 fetch_fsmap learned FSMap version 9 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.953+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d62bf3d4f0 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c04003c10 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1c0c068bb0 con 0x55d62bf219f0 2024-09-11T00:48:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 10 client.5085 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 10 client.5085 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 20 client.5085 populate_metadata read hostname 'smithi081' 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bedeee0 0x55d62bf18830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 4 client.5085 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55d62be53c60 con 0x55d62bedeee0 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.954+0000 7f1c12800640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bedeee0 0x55d62bf18830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.955+0000 7f1c12800640 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bedeee0 0x55d62bf18830 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30a45ba52a68a1e3 server_cookie=a89dd49a816d3e4f in_seq=0 out_seq=0 2024-09-11T00:48:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:57.955+0000 7f1bf3400640 10 client.5085 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.018+0000 7f1bf3400640 1 -- 172.21.15.81:0/1782595796 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d62be53c60 con 0x55d62bedeee0 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.018+0000 7f1bf3400640 10 client.5085 handle_command_reply: tid=0 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.018+0000 7f1c1c3db740 1 client.5085 shutdown 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 msgr2=0x55d62bf07450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00efd0 tx=0x7f1c0c062760 comp rx=0 tx=0).stop 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 shutdown_connections 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55d62bedeee0 0x55d62bf18830 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d62bf219f0 0x55d62bf07450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55d62bf1f220 0x55d62bf06f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 --2- 172.21.15.81:0/1782595796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d62bee3f10 0x55d62bf9eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1bf3400640 0 client.5085 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 >> 172.21.15.81:0/1782595796 conn(0x55d62bedd610 msgr2=0x55d62bf1fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 shutdown_connections 2024-09-11T00:48:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 1 -- 172.21.15.81:0/1782595796 wait complete. 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.019+0000 7f1c1c3db740 20 client.5085 trim_cache size 0 max 16384 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 18, 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "a6f57d23": { 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 18, 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:48:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 msgr2=0x7f1bf407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 0x7f1bf407a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c00007fd0 tx=0x7f1c00001c30 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 msgr2=0x7f1c140c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009cf0 tx=0x7f1c0c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 shutdown_connections 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bf4077f70 0x7f1bf407a430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141528d0 0x7f1c140c5b80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c141524f0 0x7f1c140c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 --2- 172.21.15.81:0/4269539471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c140c9480 0x7f1c1414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 >> 172.21.15.81:0/4269539471 conn(0x7f1c1406c9e0 msgr2=0x7f1c14155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 shutdown_connections 2024-09-11T00:48:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:48:58.020+0000 7f1c19400640 1 -- 172.21.15.81:0/4269539471 wait complete. 2024-09-11T00:48:58.038 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a6f57d23', quiesce took 0.8 seconds. Will release after: 29.2 2024-09-11T00:49:12.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:12.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:27.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:49:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.406+0000 7f5079c00640 1 -- 172.21.15.81:0/3227555743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074074860 msgr2=0x7f50740c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.406+0000 7f5079c00640 1 --2- 172.21.15.81:0/3227555743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074074860 0x7f50740c7980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f50740769a0 tx=0x7f506002a680 comp rx=0 tx=0).stop 2024-09-11T00:49:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.406+0000 7f5079c00640 1 -- 172.21.15.81:0/3227555743 shutdown_connections 2024-09-11T00:49:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.406+0000 7f5079c00640 1 --2- 172.21.15.81:0/3227555743 >> v2:172.21.15.167:3300/0 conn(0x7f50740c8680 0x7f50740c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.406+0000 7f5079c00640 1 --2- 172.21.15.81:0/3227555743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074074860 0x7f50740c7980 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.407+0000 7f5079c00640 1 -- 172.21.15.81:0/3227555743 >> 172.21.15.81:0/3227555743 conn(0x7f50740700f0 msgr2=0x7f5074070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.407+0000 7f5079c00640 1 -- 172.21.15.81:0/3227555743 shutdown_connections 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.407+0000 7f5079c00640 1 -- 172.21.15.81:0/3227555743 wait complete. 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.408+0000 7f5079c00640 1 Processor -- start 2024-09-11T00:49:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.408+0000 7f5079c00640 1 -- start start 2024-09-11T00:49:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5074074860 0x7f50741595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50741f4290 0x7f50741f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5074070cf0 con 0x7f5074152610 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f507415c140 con 0x7f5074074860 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.409+0000 7f5079c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f50740c16a0 con 0x7f50741f4290 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57124/0 (socket says 172.21.15.81:57124) 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 -- 172.21.15.81:0/1627502755 learned_addr learned my addr 172.21.15.81:0/1627502755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072a00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5074074860 0x7f50741595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5073400640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50741f4290 0x7f50741f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 -- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50741f4290 msgr2=0x7f50741f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50741f4290 0x7f50741f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 -- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5074074860 msgr2=0x7f50741595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5074074860 0x7f50741595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 -- 172.21.15.81:0/1627502755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50741f4c60 con 0x7f5074152610 2024-09-11T00:49:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.410+0000 7f5072000640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5060000c00 tx=0x7f5060003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.411+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060035030 con 0x7f5074152610 2024-09-11T00:49:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.411+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5060042070 con 0x7f5074152610 2024-09-11T00:49:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.411+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50741f0d50 con 0x7f5074152610 2024-09-11T00:49:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.411+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060004a00 con 0x7f5074152610 2024-09-11T00:49:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.411+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50741f12d0 con 0x7f5074152610 2024-09-11T00:49:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.412+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50741529f0 con 0x7f5074152610 2024-09-11T00:49:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.413+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5060004ba0 con 0x7f5074152610 2024-09-11T00:49:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.414+0000 7f506aa00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 0x7f505407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.414+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f50600baec0 con 0x7f5074152610 2024-09-11T00:49:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.414+0000 7f5072a00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 0x7f505407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.415+0000 7f5072a00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 0x7f505407a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5074074fb0 tx=0x7f5064009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.418+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5060082ed0 con 0x7f5074152610 2024-09-11T00:49:27.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.635+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50740c2a70 con 0x7f5074152610 2024-09-11T00:49:27.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.636+0000 7f506aa00640 1 -- 172.21.15.81:0/1627502755 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f5060087900 con 0x7f5074152610 2024-09-11T00:49:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:49:27.637 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:49:27.637 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 msgr2=0x7f505407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 0x7f505407a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5074074fb0 tx=0x7f5064009040 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 msgr2=0x7f50740cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5060000c00 tx=0x7f5060003910 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 shutdown_connections 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5054077f70 0x7f505407a430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50741f4290 0x7f50741f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5074152610 0x7f50740cb590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 --2- 172.21.15.81:0/1627502755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5074074860 0x7f50741595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 >> 172.21.15.81:0/1627502755 conn(0x7f50740700f0 msgr2=0x7f5074150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 shutdown_connections 2024-09-11T00:49:27.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.638+0000 7f5079c00640 1 -- 172.21.15.81:0/1627502755 wait complete. 2024-09-11T00:49:27.655 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id a6f57d23 --release --await' 2024-09-11T00:49:27.656 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id a6f57d23 --release --await 2024-09-11T00:49:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 -- 172.21.15.81:0/1415341879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 msgr2=0x7f56b4070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 --2- 172.21.15.81:0/1415341879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b4070c40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005fd0 tx=0x7f56a002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 -- 172.21.15.81:0/1415341879 shutdown_connections 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 --2- 172.21.15.81:0/1415341879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 --2- 172.21.15.81:0/1415341879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b4070c40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 -- 172.21.15.81:0/1415341879 >> 172.21.15.81:0/1415341879 conn(0x7f56b406ff90 msgr2=0x7f56b40703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 -- 172.21.15.81:0/1415341879 shutdown_connections 2024-09-11T00:49:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.820+0000 7f56ba200640 1 -- 172.21.15.81:0/1415341879 wait complete. 2024-09-11T00:49:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.822+0000 7f56ba200640 1 Processor -- start 2024-09-11T00:49:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.822+0000 7f56ba200640 1 -- start start 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 0x7f56b406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4074db0 con 0x7f56b40c7a70 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40c6bf0 con 0x7f56b406f760 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56ba200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f56b40c6e40 con 0x7f56b40725a0 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57146/0 (socket says 172.21.15.81:57146) 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56b3e00640 1 -- 172.21.15.81:0/351841359 learned_addr learned my addr 172.21.15.81:0/351841359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56b2a00640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.823+0000 7f56b3400640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 0x7f56b406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 -- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 msgr2=0x7f56b40b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 -- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 msgr2=0x7f56b406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 0x7f56b406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 -- 172.21.15.81:0/351841359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b41557b0 con 0x7f56b40c7a70 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b2a00640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3400640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 0x7f56b406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:49:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56b3e00640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00daa0 tx=0x7f56ac00df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56ab400640 1 -- 172.21.15.81:0/351841359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac017070 con 0x7f56b40c7a70 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56ab400640 1 -- 172.21.15.81:0/351841359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac003970 con 0x7f56b40c7a70 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56ab400640 1 -- 172.21.15.81:0/351841359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac003dc0 con 0x7f56b40c7a70 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b4155a90 con 0x7f56b40c7a70 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.824+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b40aeba0 con 0x7f56b40c7a70 2024-09-11T00:49:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.826+0000 7f56ab400640 1 -- 172.21.15.81:0/351841359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f56ac003f60 con 0x7f56b40c7a70 2024-09-11T00:49:27.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.827+0000 7f56ab400640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 0x7f569407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.827+0000 7f56ab400640 1 -- 172.21.15.81:0/351841359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f56ac09a6a0 con 0x7f56b40c7a70 2024-09-11T00:49:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 Processor -- start 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 -- start start 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56b3400640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 0x7f569407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56b3400640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 0x7f569407a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001740 tx=0x7f56a4009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c06470a370 con 0x55c0647d7810 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c0646f97a0 con 0x55c064792910 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.828+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55c0646fd5b0 con 0x55c064795b80 2024-09-11T00:49:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:55370/0 (socket says 172.21.15.81:55370) 2024-09-11T00:49:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 -- 172.21.15.81:0/2723247223 learned_addr learned my addr 172.21.15.81:0/2723247223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 -- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 msgr2=0x55c0647e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 -- 172.21.15.81:0/2723247223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 msgr2=0x55c0647cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b3e00640 1 -- 172.21.15.81:0/2723247223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c064692010 con 0x55c064792910 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.829+0000 7f56b2a00640 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f56b3e00640 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f56ac05f990 tx=0x7f56ac062ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c74821d38492b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f569f400640 1 -- 172.21.15.81:0/2723247223 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac020040 con 0x55c064792910 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f569f400640 1 -- 172.21.15.81:0/2723247223 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac06bc20 con 0x55c064792910 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f569f400640 1 -- 172.21.15.81:0/2723247223 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0883c0 con 0x55c064792910 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f56bd1d9740 1 -- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 msgr2=0x55c0647cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.830+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f56ac05f990 tx=0x7f56ac062ee0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 -- 172.21.15.81:0/2723247223 shutdown_connections 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c064792910 0x55c0647cd8d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/2723247223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 -- 172.21.15.81:0/2723247223 >> 172.21.15.81:0/2723247223 conn(0x55c064793d60 msgr2=0x55c064795240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 -- 172.21.15.81:0/2723247223 shutdown_connections 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 -- 172.21.15.81:0/2723247223 wait complete. 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.831+0000 7f56bd1d9740 1 -- start start 2024-09-11T00:49:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 Processor -- start 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d7810 0x55c0647cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c0646a0f70 con 0x55c0647d3230 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c06469f090 con 0x55c0647d7810 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.832+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55c0647d3930 con 0x55c064795b80 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56bd1d9740 10 client.0 _ll_register_callbacks cb 0x55c064408110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:49:27.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57156/0 (socket says 172.21.15.81:57156) 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 -- 172.21.15.81:0/3858089613 learned_addr learned my addr 172.21.15.81:0/3858089613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3400640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b2a00640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d7810 0x55c0647cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 -- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 msgr2=0x55c0647cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 -- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d7810 msgr2=0x55c0647cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d7810 0x55c0647cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 -- 172.21.15.81:0/3858089613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06445bea0 con 0x55c0647d3230 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f56ac05f990 tx=0x7f56ac0883f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0833301e90a2af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.833+0000 7f5693e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:49:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac020070 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f56ac061b90 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56ac06bc20 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f56ac069400 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 10 client.5103 fetch_fsmap learned FSMap version 9 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c0644d4d30 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac06bc20 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f56ac092cc0 con 0x55c0647d3230 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 10 client.5103 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 10 client.5103 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 20 client.5103 populate_metadata read hostname 'smithi081' 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c0647eb210 0x55c0647eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 4 client.5103 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.834+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c06470c2c0 con 0x55c0647eb210 2024-09-11T00:49:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.835+0000 7f56b3400640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c0647eb210 0x55c0647eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.835+0000 7f56b3400640 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c0647eb210 0x55c0647eb5f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46df5bb8c8813c20 server_cookie=994f1d154cc2d184 in_seq=0 out_seq=0 2024-09-11T00:49:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.835+0000 7f5693e00640 10 client.5103 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:49:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f5693e00640 1 -- 172.21.15.81:0/3858089613 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c06470c2c0 con 0x55c0647eb210 2024-09-11T00:49:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f5693e00640 10 client.5103 handle_command_reply: tid=0 2024-09-11T00:49:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 client.5103 shutdown 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 msgr2=0x55c0647dca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f56ac05f990 tx=0x7f56ac0883f0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 shutdown_connections 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c0647eb210 0x55c0647eb5f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d3230 0x55c0647dca10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d7810 0x55c0647cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f5693e00640 0 client.5103 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3858089613 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 >> 172.21.15.81:0/3858089613 conn(0x55c064792910 msgr2=0x55c064795180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.836+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 shutdown_connections 2024-09-11T00:49:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.837+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3858089613 wait complete. 2024-09-11T00:49:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.837+0000 7f56bd1d9740 20 client.5103 trim_cache size 0 max 16384 2024-09-11T00:49:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.854+0000 7f56bd1d9740 1 Processor -- start 2024-09-11T00:49:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.854+0000 7f56bd1d9740 1 -- start start 2024-09-11T00:49:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41ff480 con 0x55c0647d7810 2024-09-11T00:49:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41fe360 con 0x55c0647d3230 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f56b41f4b40 con 0x55c064795b80 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.855+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57172/0 (socket says 172.21.15.81:57172) 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 -- 172.21.15.81:0/447306584 learned_addr learned my addr 172.21.15.81:0/447306584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 -- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 msgr2=0x55c0647931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 -- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 msgr2=0x55c0647f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 -- 172.21.15.81:0/447306584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0647cd290 con 0x55c0647d7810 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f56b3e00640 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0621e0 tx=0x7f56ac098790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc82135d0db5b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f569ea00640 1 -- 172.21.15.81:0/447306584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac020040 con 0x55c0647d7810 2024-09-11T00:49:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f569ea00640 1 -- 172.21.15.81:0/447306584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac06bc20 con 0x55c0647d7810 2024-09-11T00:49:27.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.856+0000 7f569ea00640 1 -- 172.21.15.81:0/447306584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac05ed70 con 0x55c0647d7810 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- 172.21.15.81:0/447306584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 msgr2=0x55c0647f1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0621e0 tx=0x7f56ac098790 comp rx=0 tx=0).stop 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- 172.21.15.81:0/447306584 shutdown_connections 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647f1b80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/447306584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c0647931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- 172.21.15.81:0/447306584 >> 172.21.15.81:0/447306584 conn(0x55c064792910 msgr2=0x55c0647d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- 172.21.15.81:0/447306584 shutdown_connections 2024-09-11T00:49:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- 172.21.15.81:0/447306584 wait complete. 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.857+0000 7f56bd1d9740 1 -- start start 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.858+0000 7f56bd1d9740 1 Processor -- start 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.858+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c064796c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.858+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56bd1d9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41fcf80 con 0x55c0647d7810 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41fdc90 con 0x55c0647d3230 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56bd1d9740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f56b41fd5c0 con 0x55c064795b80 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56bd1d9740 10 client.0 _ll_register_callbacks cb 0x7f56a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57176/0 (socket says 172.21.15.81:57176) 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 -- 172.21.15.81:0/3747902464 learned_addr learned my addr 172.21.15.81:0/3747902464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3400640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c064796c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b2a00640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 -- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 msgr2=0x55c064796c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c064796c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 -- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 msgr2=0x55c0647d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647d23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 -- 172.21.15.81:0/3747902464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0647dc830 con 0x55c0647d7810 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f56b3e00640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f56ac062420 tx=0x7f56ac0672c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2467a0d20d409b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.859+0000 7f5693e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac020050 con 0x55c0647d7810 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f56ac061b90 con 0x55c0647d7810 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56ac06bc20 con 0x55c0647d7810 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f56ac05e5c0 con 0x55c0647d7810 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 10 client.5109 fetch_fsmap learned FSMap version 9 2024-09-11T00:49:27.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c0647dc830 con 0x55c0647d7810 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac06bc20 con 0x55c0647d7810 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f56ac084300 con 0x55c0647d7810 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 10 client.5109 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 10 client.5109 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 20 client.5109 populate_metadata read hostname 'smithi081' 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c064792440 0x55c0647de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 4 client.5109 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a6f57d23", "release": true, "await": true}] 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.860+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a6f57d23", "release": true, "await": true}) -- 0x55c064707d70 con 0x55c064792440 2024-09-11T00:49:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.861+0000 7f56b3400640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c064792440 0x55c0647de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:49:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.861+0000 7f56b3400640 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c064792440 0x55c0647de5e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee80225902a13f81 server_cookie=af703936a3ba2e66 in_seq=0 out_seq=0 2024-09-11T00:49:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.861+0000 7f5693e00640 10 client.5109 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f5693e00640 1 -- 172.21.15.81:0/3747902464 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c064707d70 con 0x55c064792440 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f5693e00640 10 client.5109 handle_command_reply: tid=0 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 client.5109 shutdown 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 msgr2=0x55c0647de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f56ac062420 tx=0x7f56ac0672c0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 shutdown_connections 2024-09-11T00:49:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c064792440 0x55c0647de5e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0647d7810 0x55c0647de0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c0647d3230 0x55c0647d23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 --2- 172.21.15.81:0/3747902464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c064795b80 0x55c064796c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 >> 172.21.15.81:0/3747902464 conn(0x55c064792910 msgr2=0x55c0647931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.877+0000 7f5693e00640 0 client.5109 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 shutdown_connections 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56bd1d9740 1 -- 172.21.15.81:0/3747902464 wait complete. 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56bd1d9740 20 client.5109 trim_cache size 0 max 16384 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:49:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 20, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "a6f57d23": { 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 20, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T00:49:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:49:27.882 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 msgr2=0x7f569407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 0x7f569407a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001740 tx=0x7f56a4009040 comp rx=0 tx=0).stop 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 msgr2=0x7f56b40b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00daa0 tx=0x7f56ac00df60 comp rx=0 tx=0).stop 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 shutdown_connections 2024-09-11T00:49:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5694077f70 0x7f569407a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b40c7a70 0x7f56b40b0d00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40725a0 0x7f56b40b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 --2- 172.21.15.81:0/351841359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406f760 0x7f56b406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.878+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 >> 172.21.15.81:0/351841359 conn(0x7f56b406ff90 msgr2=0x7f56b4158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.879+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 shutdown_connections 2024-09-11T00:49:27.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:49:27.879+0000 7f56ba200640 1 -- 172.21.15.81:0/351841359 wait complete. 2024-09-11T00:49:27.897 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a6f57d23', total seconds elapsed: 30.7 2024-09-11T00:49:42.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:49:42.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:12.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:12.800 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:46.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:50:46.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:51:16.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:51:17.000 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:51:19.327 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.8 2024-09-11T00:51:19.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:51:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 -- 172.21.15.81:0/3568810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 msgr2=0x7f9368151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 --2- 172.21.15.81:0/3568810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368151790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9358009860 tx=0x7f935802a620 comp rx=0 tx=0).stop 2024-09-11T00:51:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 -- 172.21.15.81:0/3568810865 shutdown_connections 2024-09-11T00:51:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 --2- 172.21.15.81:0/3568810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368151790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 -- 172.21.15.81:0/3568810865 >> 172.21.15.81:0/3568810865 conn(0x7f93680700f0 msgr2=0x7f9368070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 -- 172.21.15.81:0/3568810865 shutdown_connections 2024-09-11T00:51:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.499+0000 7f936de00640 1 -- 172.21.15.81:0/3568810865 wait complete. 2024-09-11T00:51:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.501+0000 7f936de00640 1 Processor -- start 2024-09-11T00:51:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.501+0000 7f936de00640 1 -- start start 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9368157b30 0x7f9368150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9368158380 con 0x7f9368157f50 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93681576a0 con 0x7f9368157b30 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f936de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f936806ebd0 con 0x7f93681513b0 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9367400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9366a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9366000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9368157b30 0x7f9368150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9367400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37164/0 (socket says 172.21.15.81:37164) 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9366a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:43898/0 (socket says 172.21.15.81:43898) 2024-09-11T00:51:19.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.502+0000 7f9367400640 1 -- 172.21.15.81:0/3031763898 learned_addr learned my addr 172.21.15.81:0/3031763898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 -- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 msgr2=0x7f9368146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 -- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9368157b30 msgr2=0x7f9368150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9368157b30 0x7f9368150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 -- 172.21.15.81:0/3031763898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93681550d0 con 0x7f9368157f50 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f9367400640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f936000cbc0 tx=0x7f936000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360016020 con 0x7f9368157f50 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f936000ae30 con 0x7f9368157f50 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.503+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93681e23a0 con 0x7f9368157f50 2024-09-11T00:51:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.504+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360012660 con 0x7f9368157f50 2024-09-11T00:51:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.504+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9368155510 con 0x7f9368157f50 2024-09-11T00:51:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.505+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9368074d10 con 0x7f9368157f50 2024-09-11T00:51:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.506+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9360012800 con 0x7f9368157f50 2024-09-11T00:51:19.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.507+0000 7f935f400640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 0x7f934807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.507+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f936009a900 con 0x7f9368157f50 2024-09-11T00:51:19.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.508+0000 7f9366a00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 0x7f934807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.508+0000 7f9366a00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 0x7f934807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9358034000 tx=0x7f9358004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.513+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9368074d10 con 0x7f9368157f50 2024-09-11T00:51:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.758+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9368073b30 con 0x7f9368157f50 2024-09-11T00:51:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.759+0000 7f935f400640 1 -- 172.21.15.81:0/3031763898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f9368073b30 con 0x7f9368157f50 2024-09-11T00:51:19.761 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:51:19.761 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:51:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 msgr2=0x7f934807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 0x7f934807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9358034000 tx=0x7f9358004730 comp rx=0 tx=0).stop 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 msgr2=0x7f9368145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f936000cbc0 tx=0x7f936000a430 comp rx=0 tx=0).stop 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 shutdown_connections 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9348077f70 0x7f934807a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9368157f50 0x7f9368145b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9368157b30 0x7f9368150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 --2- 172.21.15.81:0/3031763898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93681513b0 0x7f9368146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 >> 172.21.15.81:0/3031763898 conn(0x7f93680700f0 msgr2=0x7f936814aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 shutdown_connections 2024-09-11T00:51:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.761+0000 7f936de00640 1 -- 172.21.15.81:0/3031763898 wait complete. 2024-09-11T00:51:19.780 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 146.8 --await-for 45.0' 2024-09-11T00:51:19.780 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 146.8 --await-for 45.0 2024-09-11T00:51:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 -- 172.21.15.81:0/1643100890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0cc030 msgr2=0x7f9f5c0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 --2- 172.21.15.81:0/1643100890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0cc030 0x7f9f5c0cb330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cad80 tx=0x7f9f4802a5b0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 -- 172.21.15.81:0/1643100890 shutdown_connections 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 --2- 172.21.15.81:0/1643100890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0cc030 0x7f9f5c0cb330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 --2- 172.21.15.81:0/1643100890 >> v2:172.21.15.167:3300/0 conn(0x7f9f5c154810 0x7f9f5c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 -- 172.21.15.81:0/1643100890 >> 172.21.15.81:0/1643100890 conn(0x7f9f5c0688e0 msgr2=0x7f9f5c068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 -- 172.21.15.81:0/1643100890 shutdown_connections 2024-09-11T00:51:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.980+0000 7f9f60c00640 1 -- 172.21.15.81:0/1643100890 wait complete. 2024-09-11T00:51:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.982+0000 7f9f60c00640 1 Processor -- start 2024-09-11T00:51:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.982+0000 7f9f60c00640 1 -- start start 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f5c0cc030 0x7f9f5c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 0x7f9f5c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c15a500 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c15b0b0 con 0x7f9f5c154810 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f60c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0c5e20 con 0x7f9f5c0cc030 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.983+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37182/0 (socket says 172.21.15.81:37182) 2024-09-11T00:51:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 -- 172.21.15.81:0/3980927703 learned_addr learned my addr 172.21.15.81:0/3980927703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f5c0cc030 0x7f9f5c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5be00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 0x7f9f5c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 -- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f5c0cc030 msgr2=0x7f9f5c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f5c0cc030 0x7f9f5c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 -- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 msgr2=0x7f9f5c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 0x7f9f5c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 -- 172.21.15.81:0/3980927703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c157e20 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5be00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 0x7f9f5c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f5b400640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00e7c0 tx=0x7f9f4c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.984+0000 7f9f53400640 1 -- 172.21.15.81:0/3980927703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00ccc0 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.985+0000 7f9f53400640 1 -- 172.21.15.81:0/3980927703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f4c010430 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.985+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c1f0570 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.985+0000 7f9f53400640 1 -- 172.21.15.81:0/3980927703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c010860 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.985+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c1f0af0 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.987+0000 7f9f53400640 1 -- 172.21.15.81:0/3980927703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9f4c010a00 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.988+0000 7f9f53400640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 0x7f9f3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.988+0000 7f9f53400640 1 -- 172.21.15.81:0/3980927703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9f4c09a9c0 con 0x7f9f5c0c4f60 2024-09-11T00:51:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.988+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 0x7f9f3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.989+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 0x7f9f3c07a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f48004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.989+0000 7f9f65009740 1 Processor -- start 2024-09-11T00:51:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.989+0000 7f9f65009740 1 -- start start 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 0x55a12a51dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a5240c0 0x55a12a524800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a12a496260 con 0x55a12a561ba0 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a12a485690 con 0x55a12a5240c0 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.990+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a12a4894a0 con 0x55a12a51d7c0 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37194/0 (socket says 172.21.15.81:37194) 2024-09-11T00:51:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 -- 172.21.15.81:0/1424922750 learned_addr learned my addr 172.21.15.81:0/1424922750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5b400640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 0x55a12a51dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a5240c0 0x55a12a524800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 -- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 msgr2=0x55a12a51dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 0x55a12a51dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 -- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a5240c0 msgr2=0x55a12a524800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a5240c0 0x55a12a524800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 -- 172.21.15.81:0/1424922750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12a25fd80 con 0x55a12a561ba0 2024-09-11T00:51:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5b400640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 0x55a12a51dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:51:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.991+0000 7f9f5be00640 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9f54002190 tx=0x7f9f5400e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540142346d3f5d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.992+0000 7f9f47400640 1 -- 172.21.15.81:0/1424922750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54014480 con 0x55a12a561ba0 2024-09-11T00:51:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.992+0000 7f9f47400640 1 -- 172.21.15.81:0/1424922750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f54019070 con 0x55a12a561ba0 2024-09-11T00:51:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.992+0000 7f9f47400640 1 -- 172.21.15.81:0/1424922750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54014970 con 0x55a12a561ba0 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.992+0000 7f9f65009740 1 -- 172.21.15.81:0/1424922750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 msgr2=0x55a12a558d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.992+0000 7f9f65009740 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9f54002190 tx=0x7f9f5400e5f0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 -- 172.21.15.81:0/1424922750 shutdown_connections 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a561ba0 0x55a12a558d10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a5240c0 0x55a12a524800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 --2- 172.21.15.81:0/1424922750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a51d7c0 0x55a12a51dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 -- 172.21.15.81:0/1424922750 >> 172.21.15.81:0/1424922750 conn(0x55a12a51f520 msgr2=0x55a12a522df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 -- 172.21.15.81:0/1424922750 shutdown_connections 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 -- 172.21.15.81:0/1424922750 wait complete. 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 -- start start 2024-09-11T00:51:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.993+0000 7f9f65009740 1 Processor -- start 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a54b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a12a1f5cc0 con 0x55a12a5240c0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a12a42ae60 con 0x55a12a561ba0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a12a523500 con 0x55a12a54bdb0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.994+0000 7f9f65009740 10 client.0 _ll_register_callbacks cb 0x55a12a431030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37196/0 (socket says 172.21.15.81:37196) 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 -- 172.21.15.81:0/2277899392 learned_addr learned my addr 172.21.15.81:0/2277899392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5be00640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a54b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 -- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 msgr2=0x55a12a54aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 -- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 msgr2=0x55a12a54b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a54b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 -- 172.21.15.81:0/2277899392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12a2c0510 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f5b400640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c05fd60 tx=0x7f9f4c062530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca958f22177d261e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.995+0000 7f9f3be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c084d80 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9f4c061d50 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f54019070 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9f4c067310 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 10 client.5130 fetch_fsmap learned FSMap version 9 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a12a1c4c20 con 0x55a12a5240c0 2024-09-11T00:51:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f54019070 con 0x55a12a5240c0 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9f4c05e440 con 0x55a12a5240c0 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 10 client.5130 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 10 client.5130 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 20 client.5130 populate_metadata read hostname 'smithi081' 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a57f020 0x55a12a581410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 4 client.5130 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.996+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a12a4981b0 con 0x55a12a57f020 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.997+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a57f020 0x55a12a581410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.997+0000 7f9f3be00640 10 client.5130 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.997+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a57f020 0x55a12a581410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4019607f83b86bb4 server_cookie=f9f53ad5be025664 in_seq=0 out_seq=0 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.998+0000 7f9f3be00640 1 -- 172.21.15.81:0/2277899392 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a12a4981b0 con 0x55a12a57f020 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.998+0000 7f9f3be00640 10 client.5130 handle_command_reply: tid=0 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.998+0000 7f9f65009740 1 client.5130 shutdown 2024-09-11T00:51:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.998+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 msgr2=0x55a12a552790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.998+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c05fd60 tx=0x7f9f4c062530 comp rx=0 tx=0).stop 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 shutdown_connections 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a57f020 0x55a12a581410 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a54b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 --2- 172.21.15.81:0/2277899392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a552790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f3be00640 0 client.5130 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 >> 172.21.15.81:0/2277899392 conn(0x55a12a51d7c0 msgr2=0x55a12a554d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 shutdown_connections 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 1 -- 172.21.15.81:0/2277899392 wait complete. 2024-09-11T00:51:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:19.999+0000 7f9f65009740 20 client.5130 trim_cache size 0 max 16384 2024-09-11T00:51:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.021+0000 7f9f65009740 1 Processor -- start 2024-09-11T00:51:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.021+0000 7f9f65009740 1 -- start start 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a584770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1ff260 con 0x55a12a5240c0 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1fe140 con 0x55a12a561ba0 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c1fc820 con 0x55a12a54bdb0 2024-09-11T00:51:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37212/0 (socket says 172.21.15.81:37212) 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f5b400640 1 -- 172.21.15.81:0/1569366105 learned_addr learned my addr 172.21.15.81:0/1569366105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.022+0000 7f9f5be00640 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a584770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 -- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 msgr2=0x55a12a54d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 -- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 msgr2=0x55a12a584770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a584770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 -- 172.21.15.81:0/1569366105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12a552ee0 con 0x55a12a5240c0 2024-09-11T00:51:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f5b400640 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c05e910 tx=0x7f9f4c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d6633e30c4713a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f46a00640 1 -- 172.21.15.81:0/1569366105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c067310 con 0x55a12a5240c0 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f46a00640 1 -- 172.21.15.81:0/1569366105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f4c06bf40 con 0x55a12a5240c0 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.023+0000 7f9f46a00640 1 -- 172.21.15.81:0/1569366105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c05e440 con 0x55a12a5240c0 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 -- 172.21.15.81:0/1569366105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 msgr2=0x55a12a54d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c05e910 tx=0x7f9f4c009630 comp rx=0 tx=0).stop 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 -- 172.21.15.81:0/1569366105 shutdown_connections 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a584770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a54bdb0 0x55a12a54d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 --2- 172.21.15.81:0/1569366105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a5240c0 0x55a12a54d490 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 -- 172.21.15.81:0/1569366105 >> 172.21.15.81:0/1569366105 conn(0x55a12a51d7c0 msgr2=0x55a12a5244a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 -- 172.21.15.81:0/1569366105 shutdown_connections 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.024+0000 7f9f65009740 1 -- 172.21.15.81:0/1569366105 wait complete. 2024-09-11T00:51:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.025+0000 7f9f65009740 1 -- start start 2024-09-11T00:51:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.025+0000 7f9f65009740 1 Processor -- start 2024-09-11T00:51:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 0x55a12a55fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a5dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1fcdd0 con 0x55a12a54bdb0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1fda70 con 0x55a12a561ba0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.026+0000 7f9f65009740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c1fd420 con 0x55a12a5240c0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f65009740 10 client.0 _ll_register_callbacks cb 0x7f9f4c062930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 0x55a12a55fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 0x55a12a55fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:43940/0 (socket says 172.21.15.81:43940) 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37218/0 (socket says 172.21.15.81:37218) 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a5dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5b400640 1 -- 172.21.15.81:0/112834949 learned_addr learned my addr 172.21.15.81:0/112834949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 -- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 msgr2=0x55a12a55fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 0x55a12a55fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 -- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 msgr2=0x55a12a5dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a5dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 -- 172.21.15.81:0/112834949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12a57f400 con 0x55a12a54bdb0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.027+0000 7f9f5aa00640 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0d1100 tx=0x7f9f4803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd94389645d080b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48004e30 con 0x55a12a54bdb0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9f480035f0 con 0x55a12a54bdb0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f4c06bf40 con 0x55a12a54bdb0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9f480037f0 con 0x55a12a54bdb0 2024-09-11T00:51:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f65009740 10 client.5136 fetch_fsmap learned FSMap version 9 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a12a522750 con 0x55a12a54bdb0 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f4c06bf40 con 0x55a12a54bdb0 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.028+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9f48003990 con 0x55a12a54bdb0 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 10 client.5136 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 10 client.5136 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 20 client.5136 populate_metadata read hostname 'smithi081' 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a524b40 0x55a12a5defd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 4 client.5136 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.8, "await_for": 45.0}] 2024-09-11T00:51:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.8, "await_for": 45.0}) -- 0x55a12a54e500 con 0x55a12a524b40 2024-09-11T00:51:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f5b400640 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a524b40 0x55a12a5defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f5b400640 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a524b40 0x55a12a5defd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f3b4151b9b2d4c server_cookie=c431785286e25915 in_seq=0 out_seq=0 2024-09-11T00:51:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.029+0000 7f9f3be00640 10 client.5136 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f3be00640 1 -- 172.21.15.81:0/112834949 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a12a54e500 con 0x55a12a524b40 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f3be00640 10 client.5136 handle_command_reply: tid=0 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 client.5136 shutdown 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 msgr2=0x55a12a522fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0d1100 tx=0x7f9f4803f070 comp rx=0 tx=0).stop 2024-09-11T00:51:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 shutdown_connections 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a12a524b40 0x55a12a5defd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a12a561ba0 0x55a12a5dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a12a54bdb0 0x55a12a522fe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f3be00640 0 client.5136 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 --2- 172.21.15.81:0/112834949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a12a5240c0 0x55a12a55fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 >> 172.21.15.81:0/112834949 conn(0x55a12a51d7c0 msgr2=0x55a12a552400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 shutdown_connections 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 1 -- 172.21.15.81:0/112834949 wait complete. 2024-09-11T00:51:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.113+0000 7f9f65009740 20 client.5136 trim_cache size 0 max 16384 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 22, 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "664c0bb7": { 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 22, 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:51:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 146.8, 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:20.118 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:51:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 msgr2=0x7f9f3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 0x7f9f3c07a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9f48034000 tx=0x7f9f48004730 comp rx=0 tx=0).stop 2024-09-11T00:51:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 msgr2=0x7f9f5c155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00e7c0 tx=0x7f9f4c00ec80 comp rx=0 tx=0).stop 2024-09-11T00:51:20.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 shutdown_connections 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9f3c077f70 0x7f9f3c07a430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f5c154810 0x7f9f5c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f5c0cc030 0x7f9f5c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 --2- 172.21.15.81:0/3980927703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0c4f60 0x7f9f5c155140 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 >> 172.21.15.81:0/3980927703 conn(0x7f9f5c0688e0 msgr2=0x7f9f5c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 shutdown_connections 2024-09-11T00:51:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:20.114+0000 7f9f60c00640 1 -- 172.21.15.81:0/3980927703 wait complete. 2024-09-11T00:51:20.131 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '664c0bb7', quiesce took 0.8 seconds. Will release after: 26.0 2024-09-11T00:51:46.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 -- 172.21.15.81:0/2253472003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c1506d0 msgr2=0x7f297c150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 --2- 172.21.15.81:0/2253472003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c1506d0 0x7f297c150b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f297c0b2240 tx=0x7f297402a7c0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 -- 172.21.15.81:0/2253472003 shutdown_connections 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 --2- 172.21.15.81:0/2253472003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c1506d0 0x7f297c150b60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 --2- 172.21.15.81:0/2253472003 >> v2:172.21.15.167:3300/0 conn(0x7f297c15a3e0 0x7f297c15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 -- 172.21.15.81:0/2253472003 >> 172.21.15.81:0/2253472003 conn(0x7f297c0700f0 msgr2=0x7f297c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 -- 172.21.15.81:0/2253472003 shutdown_connections 2024-09-11T00:51:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.298+0000 7f2980c00640 1 -- 172.21.15.81:0/2253472003 wait complete. 2024-09-11T00:51:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.299+0000 7f2980c00640 1 Processor -- start 2024-09-11T00:51:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 -- start start 2024-09-11T00:51:46.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 0x7f297c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 0x7f297c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f297c0c21b0 con 0x7f297c15a3e0 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f297c0c1ed0 con 0x7f297c072650 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.300+0000 7f2980c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f297c0c26d0 con 0x7f297c1506d0 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44820/0 (socket says 172.21.15.81:44820) 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 -- 172.21.15.81:0/704908637 learned_addr learned my addr 172.21.15.81:0/704908637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f2979e00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 0x7f297c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 -- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 msgr2=0x7f297c1f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f2979400640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 0x7f297c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 0x7f297c1f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 -- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 msgr2=0x7f297c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 0x7f297c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 -- 172.21.15.81:0/704908637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c1458d0 con 0x7f297c15a3e0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f2979e00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 0x7f297c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f2979400640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 0x7f297c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.301+0000 7f297a800640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2974034040 tx=0x7f2974032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.302+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974041020 con 0x7f297c15a3e0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.302+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2974004130 con 0x7f297c15a3e0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.302+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974036040 con 0x7f297c15a3e0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.302+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c145b70 con 0x7f297c15a3e0 2024-09-11T00:51:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.302+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c14b740 con 0x7f297c15a3e0 2024-09-11T00:51:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.303+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c0c8700 con 0x7f297c15a3e0 2024-09-11T00:51:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.304+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2974004580 con 0x7f297c15a3e0 2024-09-11T00:51:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.305+0000 7f2972000640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 0x7f295c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.305+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f29740bb490 con 0x7f297c15a3e0 2024-09-11T00:51:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.305+0000 7f2979e00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 0x7f295c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.306+0000 7f2979e00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 0x7f295c07a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f296c009aa0 tx=0x7f296c005db0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.309+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f297404b030 con 0x7f297c15a3e0 2024-09-11T00:51:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.527+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f297c06f400 con 0x7f297c15a3e0 2024-09-11T00:51:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.527+0000 7f2972000640 1 -- 172.21.15.81:0/704908637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f2974083b80 con 0x7f297c15a3e0 2024-09-11T00:51:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:51:46.530 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:51:46.530 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:51:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.529+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 msgr2=0x7f295c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 0x7f295c07a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f296c009aa0 tx=0x7f296c005db0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 msgr2=0x7f297c1402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2974034040 tx=0x7f2974032e90 comp rx=0 tx=0).stop 2024-09-11T00:51:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 shutdown_connections 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f295c077fa0 0x7f295c07a460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f297c15a3e0 0x7f297c1402e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f297c1506d0 0x7f297c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 --2- 172.21.15.81:0/704908637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f297c072650 0x7f297c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 >> 172.21.15.81:0/704908637 conn(0x7f297c0700f0 msgr2=0x7f297c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 shutdown_connections 2024-09-11T00:51:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.530+0000 7f2980c00640 1 -- 172.21.15.81:0/704908637 wait complete. 2024-09-11T00:51:46.548 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 664c0bb7 --release --await' 2024-09-11T00:51:46.549 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 664c0bb7 --release --await 2024-09-11T00:51:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 -- 172.21.15.81:0/3619831629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d840c7a70 msgr2=0x7f4d84070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/3619831629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d840c7a70 0x7f4d84070c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005fd0 tx=0x7f4d6c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 -- 172.21.15.81:0/3619831629 shutdown_connections 2024-09-11T00:51:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/3619831629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840725a0 0x7f4d840729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/3619831629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d840c7a70 0x7f4d84070c40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.709+0000 7f4d8ae00640 1 -- 172.21.15.81:0/3619831629 >> 172.21.15.81:0/3619831629 conn(0x7f4d8406ff90 msgr2=0x7f4d840703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.710+0000 7f4d8ae00640 1 -- 172.21.15.81:0/3619831629 shutdown_connections 2024-09-11T00:51:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.710+0000 7f4d8ae00640 1 -- 172.21.15.81:0/3619831629 wait complete. 2024-09-11T00:51:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.711+0000 7f4d8ae00640 1 Processor -- start 2024-09-11T00:51:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.711+0000 7f4d8ae00640 1 -- start start 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d840725a0 0x7f4d840c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 0x7f4d8414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d84074db0 con 0x7f4d8406f760 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840c6bf0 con 0x7f4d840725a0 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d8ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840c6e40 con 0x7f4d840c7a70 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d83e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d83e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44844/0 (socket says 172.21.15.81:44844) 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d83e00640 1 -- 172.21.15.81:0/4269706773 learned_addr learned my addr 172.21.15.81:0/4269706773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d7be00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d840725a0 0x7f4d840c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.712+0000 7f4d88e00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 0x7f4d8414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 -- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 msgr2=0x7f4d8414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 0x7f4d8414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 -- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d840725a0 msgr2=0x7f4d840c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d840725a0 0x7f4d840c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 -- 172.21.15.81:0/4269706773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d840c3fa0 con 0x7f4d8406f760 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d88e00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 0x7f4d8414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d83e00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c450 tx=0x7f4d7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d80c00640 1 -- 172.21.15.81:0/4269706773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740052d0 con 0x7f4d8406f760 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d80c00640 1 -- 172.21.15.81:0/4269706773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d74005470 con 0x7f4d8406f760 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d80c00640 1 -- 172.21.15.81:0/4269706773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74012870 con 0x7f4d8406f760 2024-09-11T00:51:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8414ead0 con 0x7f4d8406f760 2024-09-11T00:51:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.713+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d841f4ea0 con 0x7f4d8406f760 2024-09-11T00:51:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.716+0000 7f4d80c00640 1 -- 172.21.15.81:0/4269706773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4d740035f0 con 0x7f4d8406f760 2024-09-11T00:51:46.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.717+0000 7f4d80c00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 0x7f4d6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.717+0000 7f4d80c00640 1 -- 172.21.15.81:0/4269706773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4d74099c00 con 0x7f4d8406f760 2024-09-11T00:51:46.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.718+0000 7f4d8dc95740 1 Processor -- start 2024-09-11T00:51:46.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.718+0000 7f4d7be00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 0x7f4d6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.718+0000 7f4d8dc95740 1 -- start start 2024-09-11T00:51:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf44fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b0910 0x55ddf44eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddf4428370 con 0x55ddf44f5810 2024-09-11T00:51:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ddf44177a0 con 0x55ddf44b0910 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ddf441b5b0 con 0x55ddf44b3b80 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 0x7f4d6007a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c033000 tx=0x7f4d6c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44848/0 (socket says 172.21.15.81:44848) 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 -- 172.21.15.81:0/2488293988 learned_addr learned my addr 172.21.15.81:0/2488293988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d88e00640 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b0910 0x55ddf44eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d83e00640 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf44fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 -- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 msgr2=0x55ddf44fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf44fec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 -- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b0910 msgr2=0x55ddf44eb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b0910 0x55ddf44eb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.719+0000 7f4d7be00640 1 -- 172.21.15.81:0/2488293988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf43b0010 con 0x55ddf44f5810 2024-09-11T00:51:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c006010 tx=0x7f4d6c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6c179b25553066 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d78c00640 1 -- 172.21.15.81:0/2488293988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c035040 con 0x55ddf44f5810 2024-09-11T00:51:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d78c00640 1 -- 172.21.15.81:0/2488293988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d6c04e070 con 0x55ddf44f5810 2024-09-11T00:51:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d78c00640 1 -- 172.21.15.81:0/2488293988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c003e50 con 0x55ddf44f5810 2024-09-11T00:51:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2488293988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 msgr2=0x55ddf44eb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.720+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c006010 tx=0x7f4d6c03c000 comp rx=0 tx=0).stop 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2488293988 shutdown_connections 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b0910 0x55ddf44eb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44eb390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2488293988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf44fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2488293988 >> 172.21.15.81:0/2488293988 conn(0x55ddf44b1d60 msgr2=0x55ddf44b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2488293988 shutdown_connections 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2488293988 wait complete. 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.721+0000 7f4d8dc95740 1 -- start start 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.722+0000 7f4d8dc95740 1 Processor -- start 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.722+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf4509fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44e8810 0x55ddf44dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ddf43bef70 con 0x55ddf44f5810 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ddf43bd090 con 0x55ddf44e8810 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ddf44b5640 con 0x55ddf44b3b80 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d8dc95740 10 client.0 _ll_register_callbacks cb 0x55ddf4126110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44852/0 (socket says 172.21.15.81:44852) 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 -- 172.21.15.81:0/2138098592 learned_addr learned my addr 172.21.15.81:0/2138098592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 -- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 msgr2=0x55ddf4509fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf4509fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 -- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44e8810 msgr2=0x55ddf44dffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44e8810 0x55ddf44dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 -- 172.21.15.81:0/2138098592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf4179ea0 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d7be00640 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c006010 tx=0x7f4d6c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ea9df0faa75524 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.723+0000 7f4d71600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c03ca00 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4d6c03cba0 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d6c04e070 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4d6c064050 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d8dc95740 10 client.5157 fetch_fsmap learned FSMap version 9 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ddf41f2d30 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d6c04e070 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.724+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f4d6c067020 con 0x55ddf44f5810 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 10 client.5157 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 10 client.5157 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 20 client.5157 populate_metadata read hostname 'smithi081' 2024-09-11T00:51:46.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44f06b0 0x55ddf44f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 4 client.5157 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:51:46.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf442a2c0 con 0x55ddf44f06b0 2024-09-11T00:51:46.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.725+0000 7f4d83e00640 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44f06b0 0x55ddf44f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.726+0000 7f4d83e00640 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44f06b0 0x55ddf44f0b60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492b5ebcd80529a3 server_cookie=7594ee13b2e2cea3 in_seq=0 out_seq=0 2024-09-11T00:51:46.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.726+0000 7f4d71600640 10 client.5157 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.726+0000 7f4d71600640 1 -- 172.21.15.81:0/2138098592 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddf442a2c0 con 0x55ddf44f06b0 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.726+0000 7f4d71600640 10 client.5157 handle_command_reply: tid=0 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.726+0000 7f4d8dc95740 1 client.5157 shutdown 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 msgr2=0x55ddf44b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c006010 tx=0x7f4d6c005850 comp rx=0 tx=0).stop 2024-09-11T00:51:46.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 shutdown_connections 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44f06b0 0x55ddf44f0b60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44e8810 0x55ddf44dffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44b4ef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d71600640 0 client.5157 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/2138098592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44b3b80 0x55ddf4509fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 >> 172.21.15.81:0/2138098592 conn(0x55ddf44b0910 msgr2=0x55ddf44b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 shutdown_connections 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 1 -- 172.21.15.81:0/2138098592 wait complete. 2024-09-11T00:51:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.727+0000 7f4d8dc95740 20 client.5157 trim_cache size 0 max 16384 2024-09-11T00:51:46.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.745+0000 7f4d8dc95740 1 Processor -- start 2024-09-11T00:51:46.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.745+0000 7f4d8dc95740 1 -- start start 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf44b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841ff250 con 0x55ddf44f5810 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841fe130 con 0x55ddf44b3b80 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840c50d0 con 0x55ddf44e8810 2024-09-11T00:51:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44856/0 (socket says 172.21.15.81:44856) 2024-09-11T00:51:46.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 -- 172.21.15.81:0/674844858 learned_addr learned my addr 172.21.15.81:0/674844858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d7be00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf44b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d83e00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 -- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 msgr2=0x55ddf44b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf44b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 -- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 msgr2=0x55ddf44b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d88e00640 1 -- 172.21.15.81:0/674844858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf44b0730 con 0x55ddf44f5810 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.746+0000 7f4d83e00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d88e00640 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009ed0 tx=0x7f4d7c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb0f045f41d1ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d73e00640 1 -- 172.21.15.81:0/674844858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01b640 con 0x55ddf44f5810 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d73e00640 1 -- 172.21.15.81:0/674844858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d7c01b7e0 con 0x55ddf44f5810 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d73e00640 1 -- 172.21.15.81:0/674844858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01bc10 con 0x55ddf44f5810 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 -- 172.21.15.81:0/674844858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 msgr2=0x55ddf44fd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009ed0 tx=0x7f4d7c012820 comp rx=0 tx=0).stop 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 -- 172.21.15.81:0/674844858 shutdown_connections 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf44fd490 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf44b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/674844858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 -- 172.21.15.81:0/674844858 >> 172.21.15.81:0/674844858 conn(0x55ddf44b0910 msgr2=0x55ddf44afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 -- 172.21.15.81:0/674844858 shutdown_connections 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.747+0000 7f4d8dc95740 1 -- 172.21.15.81:0/674844858 wait complete. 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.748+0000 7f4d8dc95740 1 -- start start 2024-09-11T00:51:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.748+0000 7f4d8dc95740 1 Processor -- start 2024-09-11T00:51:46.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf45745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf4574af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8414e510 con 0x55ddf44f5810 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841fda90 con 0x55ddf44b3b80 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4d841fd3c0 con 0x55ddf44e8810 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d8dc95740 10 client.0 _ll_register_callbacks cb 0x7f4d6c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d88e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf4574af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d83e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d83e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:36940/0 (socket says 172.21.15.81:36940) 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.749+0000 7f4d83e00640 1 -- 172.21.15.81:0/1776225636 learned_addr learned my addr 172.21.15.81:0/1776225636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d7be00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf45745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 -- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 msgr2=0x55ddf45745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf45745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 -- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 msgr2=0x55ddf44e6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 -- 172.21.15.81:0/1776225636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf44fe420 con 0x55ddf44f5810 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d83e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d88e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf4574af0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009ed0 tx=0x7f4d7c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9d6bda9fb55cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d71600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c020040 con 0x55ddf44f5810 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f4d7c01bb90 con 0x55ddf44f5810 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.750+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c01b7e0 con 0x55ddf44f5810 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4d7c031050 con 0x55ddf44f5810 2024-09-11T00:51:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 10 client.5163 fetch_fsmap learned FSMap version 9 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ddf44ab570 con 0x55ddf44f5810 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d7c01b7e0 con 0x55ddf44f5810 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f4d7c034020 con 0x55ddf44f5810 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 10 client.5163 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 10 client.5163 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 20 client.5163 populate_metadata read hostname 'smithi081' 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44e96e0 0x55ddf44ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 4 client.5163 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "664c0bb7", "release": true, "await": true}] 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.751+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "664c0bb7", "release": true, "await": true}) -- 0x55ddf4425d70 con 0x55ddf44e96e0 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.752+0000 7f4d83e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44e96e0 0x55ddf44ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.752+0000 7f4d83e00640 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44e96e0 0x55ddf44ee5d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=370ca5a4e26c0c76 server_cookie=f622db507c516561 in_seq=0 out_seq=0 2024-09-11T00:51:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.752+0000 7f4d71600640 10 client.5163 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d71600640 1 -- 172.21.15.81:0/1776225636 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ddf4425d70 con 0x55ddf44e96e0 2024-09-11T00:51:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d71600640 10 client.5163 handle_command_reply: tid=0 2024-09-11T00:51:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 client.5163 shutdown 2024-09-11T00:51:46.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 msgr2=0x55ddf4574af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf4574af0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009ed0 tx=0x7f4d7c004ce0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 shutdown_connections 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ddf44e96e0 0x55ddf44ee5d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ddf44f5810 0x55ddf4574af0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ddf44e8810 0x55ddf45745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 --2- 172.21.15.81:0/1776225636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddf44b3b80 0x55ddf44e6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 >> 172.21.15.81:0/1776225636 conn(0x55ddf44b0910 msgr2=0x55ddf44afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d71600640 0 client.5163 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 shutdown_connections 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 1 -- 172.21.15.81:0/1776225636 wait complete. 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.782+0000 7f4d8dc95740 20 client.5163 trim_cache size 0 max 16384 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 24, 2024-09-11T00:51:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "664c0bb7": { 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 24, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 146.8, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:51:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:51:46.792 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 msgr2=0x7f4d6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 0x7f4d6007a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c033000 tx=0x7f4d6c004730 comp rx=0 tx=0).stop 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 msgr2=0x7f4d840afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c450 tx=0x7f4d7400c910 comp rx=0 tx=0).stop 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 shutdown_connections 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f4d60077f70 0x7f4d6007a430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d840c7a70 0x7f4d8414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d840725a0 0x7f4d840c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 --2- 172.21.15.81:0/4269706773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8406f760 0x7f4d840afd30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 >> 172.21.15.81:0/4269706773 conn(0x7f4d8406ff90 msgr2=0x7f4d841585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 shutdown_connections 2024-09-11T00:51:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:51:46.783+0000 7f4d8ae00640 1 -- 172.21.15.81:0/4269706773 wait complete. 2024-09-11T00:51:46.803 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '664c0bb7', total seconds elapsed: 27.5 2024-09-11T00:51:47.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:51:47.096 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:52:17.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:52:17.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:52:36.576 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.4 2024-09-11T00:52:36.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:52:36.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 -- 172.21.15.81:0/3409618185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df4152780 msgr2=0x7f2df40c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 --2- 172.21.15.81:0/3409618185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df4152780 0x7f2df40c8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009830 tx=0x7f2de802a510 comp rx=0 tx=0).stop 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 -- 172.21.15.81:0/3409618185 shutdown_connections 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 --2- 172.21.15.81:0/3409618185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df415b880 0x7f2df40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 --2- 172.21.15.81:0/3409618185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df4152780 0x7f2df40c8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 -- 172.21.15.81:0/3409618185 >> 172.21.15.81:0/3409618185 conn(0x7f2df40ca9b0 msgr2=0x7f2df40cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 -- 172.21.15.81:0/3409618185 shutdown_connections 2024-09-11T00:52:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.751+0000 7f2dfae00640 1 -- 172.21.15.81:0/3409618185 wait complete. 2024-09-11T00:52:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.753+0000 7f2dfae00640 1 Processor -- start 2024-09-11T00:52:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.753+0000 7f2dfae00640 1 -- start start 2024-09-11T00:52:36.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4152780 0x7f2df414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df415b880 0x7f2df414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4158290 con 0x7f2df4152780 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4159140 con 0x7f2df415b880 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2df40cb4d0 con 0x7f2df40c3110 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2df9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2df9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4152780 0x7f2df414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2df9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:56468/0 (socket says 172.21.15.81:56468) 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2df9a00640 1 -- 172.21.15.81:0/1514700704 learned_addr learned my addr 172.21.15.81:0/1514700704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.754+0000 7f2dfa400640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df415b880 0x7f2df414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 -- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df415b880 msgr2=0x7f2df414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df415b880 0x7f2df414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 -- 172.21.15.81:0/1514700704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4152780 msgr2=0x7f2df414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4152780 0x7f2df414e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 -- 172.21.15.81:0/1514700704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df41f2520 con 0x7f2df40c3110 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df9a00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de8032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8040070 con 0x7f2df40c3110 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de80038e0 con 0x7f2df40c3110 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.755+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8005c90 con 0x7f2df40c3110 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.756+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df41f2800 con 0x7f2df40c3110 2024-09-11T00:52:36.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.756+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df41f2dc0 con 0x7f2df40c3110 2024-09-11T00:52:36.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.757+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df4076620 con 0x7f2df40c3110 2024-09-11T00:52:36.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.758+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2de8045460 con 0x7f2df40c3110 2024-09-11T00:52:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.759+0000 7f2df1600640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 0x7f2dd407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.760+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2de80bb680 con 0x7f2df40c3110 2024-09-11T00:52:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.760+0000 7f2df9000640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 0x7f2dd407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.760+0000 7f2df9000640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 0x7f2dd407a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2de00095f0 tx=0x7f2de0005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:36.764+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2de804c030 con 0x7f2df40c3110 2024-09-11T00:52:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.028+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df40b3a00 con 0x7f2df40c3110 2024-09-11T00:52:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.029+0000 7f2df1600640 1 -- 172.21.15.81:0/1514700704 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f2de8083690 con 0x7f2df40c3110 2024-09-11T00:52:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:52:37.031 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:52:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:52:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.031+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 msgr2=0x7f2dd407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.031+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 0x7f2dd407a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2de00095f0 tx=0x7f2de0005f90 comp rx=0 tx=0).stop 2024-09-11T00:52:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.031+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 msgr2=0x7f2df41f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.031+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de8032c10 comp rx=0 tx=0).stop 2024-09-11T00:52:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 shutdown_connections 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2dd4077f70 0x7f2dd407a430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df415b880 0x7f2df414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4152780 0x7f2df414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 --2- 172.21.15.81:0/1514700704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2df40c3110 0x7f2df41f1f00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 >> 172.21.15.81:0/1514700704 conn(0x7f2df40ca9b0 msgr2=0x7f2df40c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 shutdown_connections 2024-09-11T00:52:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.032+0000 7f2dfae00640 1 -- 172.21.15.81:0/1514700704 wait complete. 2024-09-11T00:52:37.050 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 148.4 --await-for 45.0' 2024-09-11T00:52:37.050 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 148.4 --await-for 45.0 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 -- 172.21.15.81:0/2364842968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0068ff0 msgr2=0x7f1bd00c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 --2- 172.21.15.81:0/2364842968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0068ff0 0x7f1bd00c5010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0154fb0 tx=0x7f1bc002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 -- 172.21.15.81:0/2364842968 shutdown_connections 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 --2- 172.21.15.81:0/2364842968 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd00693f0 0x7f1bd00c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 --2- 172.21.15.81:0/2364842968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0068ff0 0x7f1bd00c5010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 --2- 172.21.15.81:0/2364842968 >> v2:172.21.15.167:3300/0 conn(0x7f1bd0154a20 0x7f1bd015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 -- 172.21.15.81:0/2364842968 >> 172.21.15.81:0/2364842968 conn(0x7f1bd006d570 msgr2=0x7f1bd00688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 -- 172.21.15.81:0/2364842968 shutdown_connections 2024-09-11T00:52:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.233+0000 7f1bd8800640 1 -- 172.21.15.81:0/2364842968 wait complete. 2024-09-11T00:52:37.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.235+0000 7f1bd8800640 1 Processor -- start 2024-09-11T00:52:37.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.235+0000 7f1bd8800640 1 -- start start 2024-09-11T00:52:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd0068ff0 0x7f1bd014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd0154a20 0x7f1bd01f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00ccd50 con 0x7f1bd00693f0 2024-09-11T00:52:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00cca70 con 0x7f1bd0068ff0 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd8800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd00cd030 con 0x7f1bd0154a20 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59384/0 (socket says 172.21.15.81:59384) 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5400640 1 -- 172.21.15.81:0/424824118 learned_addr learned my addr 172.21.15.81:0/424824118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd0068ff0 0x7f1bd014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd6800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd0154a20 0x7f1bd01f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5400640 1 -- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd0154a20 msgr2=0x7f1bd01f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.236+0000 7f1bd5400640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd0154a20 0x7f1bd01f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd5400640 1 -- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd0068ff0 msgr2=0x7f1bd014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd5400640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd0068ff0 0x7f1bd014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd5400640 1 -- 172.21.15.81:0/424824118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd00c7c50 con 0x7f1bd00693f0 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd5400640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005fd0 tx=0x7f1bc00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bca000640 1 -- 172.21.15.81:0/424824118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc003f070 con 0x7f1bd00693f0 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bca000640 1 -- 172.21.15.81:0/424824118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc00047a0 con 0x7f1bd00693f0 2024-09-11T00:52:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bca000640 1 -- 172.21.15.81:0/424824118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0035030 con 0x7f1bd00693f0 2024-09-11T00:52:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd015d400 con 0x7f1bd00693f0 2024-09-11T00:52:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.237+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd015d6a0 con 0x7f1bd00693f0 2024-09-11T00:52:37.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.240+0000 7f1bca000640 1 -- 172.21.15.81:0/424824118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1bc0004bf0 con 0x7f1bd00693f0 2024-09-11T00:52:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.241+0000 7f1bca000640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 0x7f1bb407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.241+0000 7f1bca000640 1 -- 172.21.15.81:0/424824118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1bc00baff0 con 0x7f1bd00693f0 2024-09-11T00:52:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.241+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 0x7f1bb407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.241+0000 7f1bdb63a740 1 Processor -- start 2024-09-11T00:52:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.242+0000 7f1bdb63a740 1 -- start start 2024-09-11T00:52:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.242+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 0x7f1bb407a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400bb50 tx=0x7f1bc400b2e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f21f10 0x55a002f22650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f56b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a002e94260 con 0x55a002f1b610 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a002e83690 con 0x55a002f21f10 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a002e874a0 con 0x55a002f5f9f0 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59390/0 (socket says 172.21.15.81:59390) 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 -- 172.21.15.81:0/3370399108 learned_addr learned my addr 172.21.15.81:0/3370399108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5400640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f21f10 0x55a002f22650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd6800640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f56b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 -- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 msgr2=0x55a002f56b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f56b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 -- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f21f10 msgr2=0x55a002f22650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f21f10 0x55a002f22650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd5e00640 1 -- 172.21.15.81:0/3370399108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a002c5dd80 con 0x55a002f1b610 2024-09-11T00:52:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.243+0000 7f1bd6800640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f56b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.244+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4010fb0 tx=0x7f1bc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267fe3a71276ee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.244+0000 7f1bbe600640 1 -- 172.21.15.81:0/3370399108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401e620 con 0x55a002f1b610 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.244+0000 7f1bbe600640 1 -- 172.21.15.81:0/3370399108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc401e7c0 con 0x55a002f1b610 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.244+0000 7f1bbe600640 1 -- 172.21.15.81:0/3370399108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401ebb0 con 0x55a002f1b610 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3370399108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 msgr2=0x55a002f1b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4010fb0 tx=0x7f1bc4013000 comp rx=0 tx=0).stop 2024-09-11T00:52:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3370399108 shutdown_connections 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f56b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f21f10 0x55a002f22650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3370399108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f1b610 0x55a002f1b9f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3370399108 >> 172.21.15.81:0/3370399108 conn(0x55a002f1d370 msgr2=0x55a002f20c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3370399108 shutdown_connections 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.245+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3370399108 wait complete. 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.246+0000 7f1bdb63a740 1 -- start start 2024-09-11T00:52:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.246+0000 7f1bdb63a740 1 Processor -- start 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002f75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f49fc0 0x55a002f5ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a002bf3cc0 con 0x55a002f21f10 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a002e28e60 con 0x55a002f5f9f0 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a002f21350 con 0x55a002f49fc0 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bdb63a740 10 client.0 _ll_register_callbacks cb 0x55a002e2f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59406/0 (socket says 172.21.15.81:59406) 2024-09-11T00:52:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1367851173 learned_addr learned my addr 172.21.15.81:0/1367851173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bd6800640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f49fc0 0x55a002f5ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.247+0000 7f1bd5400640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002f75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f49fc0 msgr2=0x55a002f5ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f49fc0 0x55a002f5ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 msgr2=0x55a002f75470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002f75470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1367851173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a002cbe510 con 0x55a002f21f10 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a002f61bf0 tx=0x7f1bc401e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a24f4d7b7fa0d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bb2a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4034060 con 0x55a002f21f10 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1bc401eb80 con 0x55a002f21f10 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.248+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc401e7c0 con 0x55a002f21f10 2024-09-11T00:52:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1bc401ed80 con 0x55a002f21f10 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 10 client.5181 fetch_fsmap learned FSMap version 9 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a002bc2c20 con 0x55a002f21f10 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc401e7c0 con 0x55a002f21f10 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1bc4035280 con 0x55a002f21f10 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 10 client.5181 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 10 client.5181 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 20 client.5181 populate_metadata read hostname 'smithi081' 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002f4a440 0x55a002f71840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 4 client.5181 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.249+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a002e961b0 con 0x55a002f4a440 2024-09-11T00:52:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.250+0000 7f1bd5400640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002f4a440 0x55a002f71840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.250+0000 7f1bd5400640 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002f4a440 0x55a002f71840 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c426b6020256fc45 server_cookie=3f15fa68fb7ee15c in_seq=0 out_seq=0 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.250+0000 7f1bb2a00640 10 client.5181 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bb2a00640 1 -- 172.21.15.81:0/1367851173 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a002e961b0 con 0x55a002f4a440 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bb2a00640 10 client.5181 handle_command_reply: tid=0 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 client.5181 shutdown 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 msgr2=0x55a002f509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a002f61bf0 tx=0x7f1bc401e650 comp rx=0 tx=0).stop 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 shutdown_connections 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002f4a440 0x55a002f71840 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f49fc0 0x55a002f5ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002f75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1367851173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f509e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 >> 172.21.15.81:0/1367851173 conn(0x55a002f1b610 msgr2=0x55a002f4f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.251+0000 7f1bb2a00640 0 client.5181 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:52:37.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.252+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 shutdown_connections 2024-09-11T00:52:37.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.252+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1367851173 wait complete. 2024-09-11T00:52:37.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.252+0000 7f1bdb63a740 20 client.5181 trim_cache size 0 max 16384 2024-09-11T00:52:37.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.269+0000 7f1bdb63a740 1 Processor -- start 2024-09-11T00:52:37.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.270+0000 7f1bdb63a740 1 -- start start 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 0x55a002f856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f85c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01ff450 con 0x55a002f21f10 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01fe330 con 0x55a002f49fc0 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd01f1510 con 0x55a002f5f9f0 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59418/0 (socket says 172.21.15.81:59418) 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1623255410 learned_addr learned my addr 172.21.15.81:0/1623255410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd6800640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f85c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5400640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 0x55a002f856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 msgr2=0x55a002f85c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f85c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 msgr2=0x55a002f856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 0x55a002f856f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5e00640 1 -- 172.21.15.81:0/1623255410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a002f1f940 con 0x55a002f21f10 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.271+0000 7f1bd5400640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 0x55a002f856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.272+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4032040 tx=0x7f1bc401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b314631b32b5501 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.272+0000 7f1bbdc00640 1 -- 172.21.15.81:0/1623255410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4034020 con 0x55a002f21f10 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.272+0000 7f1bbdc00640 1 -- 172.21.15.81:0/1623255410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc402a030 con 0x55a002f21f10 2024-09-11T00:52:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.272+0000 7f1bbdc00640 1 -- 172.21.15.81:0/1623255410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc403a020 con 0x55a002f21f10 2024-09-11T00:52:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1623255410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 msgr2=0x55a002f1c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4032040 tx=0x7f1bc401ed10 comp rx=0 tx=0).stop 2024-09-11T00:52:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1623255410 shutdown_connections 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f5f9f0 0x55a002f85c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f49fc0 0x55a002f856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/1623255410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f21f10 0x55a002f1c9e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1623255410 >> 172.21.15.81:0/1623255410 conn(0x55a002f1b610 msgr2=0x55a002f5aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1623255410 shutdown_connections 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- 172.21.15.81:0/1623255410 wait complete. 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.273+0000 7f1bdb63a740 1 -- start start 2024-09-11T00:52:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.274+0000 7f1bdb63a740 1 Processor -- start 2024-09-11T00:52:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f21f10 0x55a002f1ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002fdb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01fcf80 con 0x55a002f49fc0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd01fdc60 con 0x55a002f5f9f0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd01fd5d0 con 0x55a002f21f10 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bdb63a740 10 client.0 _ll_register_callbacks cb 0x7f1bc400b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002fdb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 -- 172.21.15.81:0/3316249121 learned_addr learned my addr 172.21.15.81:0/3316249121 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f21f10 0x55a002f1ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 -- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f21f10 msgr2=0x55a002f1ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f21f10 0x55a002f1ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 -- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 msgr2=0x55a002fdb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.275+0000 7f1bd5400640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002fdb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bd5400640 1 -- 172.21.15.81:0/3316249121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a002f16c00 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bd6800640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002fdb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bd5400640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00b91c0 tx=0x7f1bc0082970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85d2459d4890842 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bb2a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0049040 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1bc008c100 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc402a030 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1bc008ae60 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bdb63a740 10 client.5187 fetch_fsmap learned FSMap version 9 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a002f84650 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.276+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc402a030 con 0x55a002f49fc0 2024-09-11T00:52:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1bc0098b80 con 0x55a002f49fc0 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 10 client.5187 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 10 client.5187 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 20 client.5187 populate_metadata read hostname 'smithi081' 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002fdbc60 0x55a002f6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 4 client.5187 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.4, "await_for": 45.0}] 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.4, "await_for": 45.0}) -- 0x55a002e91c60 con 0x55a002fdbc60 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.277+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002fdbc60 0x55a002f6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.278+0000 7f1bb2a00640 10 client.5187 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:52:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.278+0000 7f1bd5e00640 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002fdbc60 0x55a002f6e2c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f7a57d41477f6f server_cookie=af517e40e12c82d0 in_seq=0 out_seq=0 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bb2a00640 1 -- 172.21.15.81:0/3316249121 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a002e91c60 con 0x55a002fdbc60 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bb2a00640 10 client.5187 handle_command_reply: tid=0 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 client.5187 shutdown 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 msgr2=0x55a002f60730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00b91c0 tx=0x7f1bc0082970 comp rx=0 tx=0).stop 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 shutdown_connections 2024-09-11T00:52:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a002fdbc60 0x55a002f6e2c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a002f5f9f0 0x55a002fdb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a002f49fc0 0x55a002f60730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bb2a00640 0 client.5187 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 --2- 172.21.15.81:0/3316249121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a002f21f10 0x55a002f1ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 >> 172.21.15.81:0/3316249121 conn(0x55a002f1b610 msgr2=0x55a002f4f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.379+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 shutdown_connections 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bdb63a740 1 -- 172.21.15.81:0/3316249121 wait complete. 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bdb63a740 20 client.5187 trim_cache size 0 max 16384 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:52:37.383 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 26, 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "fc2e8ea2": { 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 26, 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:52:37.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:52:37.385 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 msgr2=0x7f1bb407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 0x7f1bb407a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400bb50 tx=0x7f1bc400b2e0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 msgr2=0x7f1bd015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.380+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005fd0 tx=0x7f1bc00038a0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 shutdown_connections 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1bb4077f70 0x7f1bb407a430 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd0154a20 0x7f1bd01f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd00693f0 0x7f1bd015de80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 --2- 172.21.15.81:0/424824118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd0068ff0 0x7f1bd014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:52:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 >> 172.21.15.81:0/424824118 conn(0x7f1bd006d570 msgr2=0x7f1bd00b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:52:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 shutdown_connections 2024-09-11T00:52:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:52:37.381+0000 7f1bd8800640 1 -- 172.21.15.81:0/424824118 wait complete. 2024-09-11T00:52:37.399 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fc2e8ea2', quiesce took 0.8 seconds. Will release after: 27.599999999999998 2024-09-11T00:52:47.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:52:47.326 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:05.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 -- 172.21.15.81:0/3615100769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71180b1f10 msgr2=0x7f71180745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 --2- 172.21.15.81:0/3615100769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71180b1f10 0x7f71180745f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7104009830 tx=0x7f710402a5c0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 -- 172.21.15.81:0/3615100769 shutdown_connections 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 --2- 172.21.15.81:0/3615100769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71180b1f10 0x7f71180745f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 -- 172.21.15.81:0/3615100769 >> 172.21.15.81:0/3615100769 conn(0x7f711806ffd0 msgr2=0x7f71180703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 -- 172.21.15.81:0/3615100769 shutdown_connections 2024-09-11T00:53:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.166+0000 7f711d800640 1 -- 172.21.15.81:0/3615100769 wait complete. 2024-09-11T00:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.168+0000 7f711d800640 1 Processor -- start 2024-09-11T00:53:05.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.168+0000 7f711d800640 1 -- start start 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.168+0000 7f711d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71180b1f10 0x7f71181f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f711814ebc0 0x7f71181493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71180c7040 con 0x7f7118074b30 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71181581a0 con 0x7f71180b1f10 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f711814efa0 con 0x7f711814ebc0 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41600/0 (socket says 172.21.15.81:41600) 2024-09-11T00:53:05.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 -- 172.21.15.81:0/2230205016 learned_addr learned my addr 172.21.15.81:0/2230205016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117400640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71180b1f10 0x7f71181f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f711ce00640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f711814ebc0 0x7f71181493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 -- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f711814ebc0 msgr2=0x7f71181493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f711814ebc0 0x7f71181493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 -- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71180b1f10 msgr2=0x7f71181f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71180b1f10 0x7f71181f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 -- 172.21.15.81:0/2230205016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711814e360 con 0x7f7118074b30 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.169+0000 7f7117e00640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f710800c3a0 tx=0x7f710800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.170+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108017070 con 0x7f7118074b30 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.170+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71080053c0 con 0x7f7118074b30 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.170+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71181f46c0 con 0x7f7118074b30 2024-09-11T00:53:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.170+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108003850 con 0x7f7118074b30 2024-09-11T00:53:05.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.170+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7118159d50 con 0x7f7118074b30 2024-09-11T00:53:05.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.171+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71180745f0 con 0x7f7118074b30 2024-09-11T00:53:05.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.172+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71080039f0 con 0x7f7118074b30 2024-09-11T00:53:05.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.173+0000 7f710fe00640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 0x7f70f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.173+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7108099680 con 0x7f7118074b30 2024-09-11T00:53:05.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.173+0000 7f7117400640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 0x7f70f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.174+0000 7f7117400640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 0x7f70f807a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7104034000 tx=0x7f7104004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.177+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7108061ea0 con 0x7f7118074b30 2024-09-11T00:53:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.398+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71180c7a70 con 0x7f7118074b30 2024-09-11T00:53:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.399+0000 7f710fe00640 1 -- 172.21.15.81:0/2230205016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f71080617a0 con 0x7f7118074b30 2024-09-11T00:53:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:53:05.401 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:53:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:53:05.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 msgr2=0x7f70f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 0x7f70f807a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7104034000 tx=0x7f7104004730 comp rx=0 tx=0).stop 2024-09-11T00:53:05.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 msgr2=0x7f711814c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f710800c3a0 tx=0x7f710800c860 comp rx=0 tx=0).stop 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 shutdown_connections 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70f8077f70 0x7f70f807a430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f711814ebc0 0x7f71181493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71180b1f10 0x7f71181f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 --2- 172.21.15.81:0/2230205016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7118074b30 0x7f711814c3e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 >> 172.21.15.81:0/2230205016 conn(0x7f711806ffd0 msgr2=0x7f7118156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 shutdown_connections 2024-09-11T00:53:05.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.401+0000 7f711d800640 1 -- 172.21.15.81:0/2230205016 wait complete. 2024-09-11T00:53:05.418 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id fc2e8ea2 --release --await' 2024-09-11T00:53:05.418 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id fc2e8ea2 --release --await 2024-09-11T00:53:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 -- 172.21.15.81:0/1530728749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 msgr2=0x7f2ba00c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 --2- 172.21.15.81:0/1530728749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba00c7790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ba006fc30 tx=0x7f2b8802a560 comp rx=0 tx=0).stop 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 -- 172.21.15.81:0/1530728749 shutdown_connections 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 --2- 172.21.15.81:0/1530728749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 0x7f2ba015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 --2- 172.21.15.81:0/1530728749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba00c7790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 --2- 172.21.15.81:0/1530728749 >> v2:172.21.15.167:3300/0 conn(0x7f2ba006f760 0x7f2ba0070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 -- 172.21.15.81:0/1530728749 >> 172.21.15.81:0/1530728749 conn(0x7f2ba006ff90 msgr2=0x7f2ba00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 -- 172.21.15.81:0/1530728749 shutdown_connections 2024-09-11T00:53:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.582+0000 7f2ba5200640 1 -- 172.21.15.81:0/1530728749 wait complete. 2024-09-11T00:53:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.584+0000 7f2ba5200640 1 Processor -- start 2024-09-11T00:53:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.584+0000 7f2ba5200640 1 -- start start 2024-09-11T00:53:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 0x7f2ba01f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 0x7f2ba00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0074ad0 con 0x7f2ba00c7360 2024-09-11T00:53:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0159330 con 0x7f2ba006f760 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2ba5200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba0074db0 con 0x7f2ba015baa0 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41606/0 (socket says 172.21.15.81:41606) 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 -- 172.21.15.81:0/579147572 learned_addr learned my addr 172.21.15.81:0/579147572 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b9de00640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 0x7f2ba01f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b9e800640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 0x7f2ba00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 -- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 msgr2=0x7f2ba00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 0x7f2ba00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 -- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 msgr2=0x7f2ba01f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 0x7f2ba01f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b95400640 1 -- 172.21.15.81:0/579147572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba01f18c0 con 0x7f2ba00c7360 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.585+0000 7f2b9de00640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 0x7f2ba01f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2b95400640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000c00 tx=0x7f2b88003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2b96a00640 1 -- 172.21.15.81:0/579147572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8803f070 con 0x7f2ba00c7360 2024-09-11T00:53:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2b96a00640 1 -- 172.21.15.81:0/579147572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b880047a0 con 0x7f2ba00c7360 2024-09-11T00:53:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2b96a00640 1 -- 172.21.15.81:0/579147572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88035030 con 0x7f2ba00c7360 2024-09-11T00:53:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba0152f40 con 0x7f2ba00c7360 2024-09-11T00:53:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.586+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba00aee10 con 0x7f2ba00c7360 2024-09-11T00:53:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.588+0000 7f2b96a00640 1 -- 172.21.15.81:0/579147572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2b88004bb0 con 0x7f2ba00c7360 2024-09-11T00:53:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.590+0000 7f2b96a00640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 0x7f2b7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.590+0000 7f2b96a00640 1 -- 172.21.15.81:0/579147572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2b880bb370 con 0x7f2ba00c7360 2024-09-11T00:53:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.590+0000 7f2b9de00640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 0x7f2b7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.590+0000 7f2ba8097740 1 Processor -- start 2024-09-11T00:53:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 -- start start 2024-09-11T00:53:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2b9de00640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 0x7f2b7c07a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005e00 tx=0x7f2b90005d50 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19e3810 0x5610e19d9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5610e1916370 con 0x5610e199e910 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5610e19057a0 con 0x5610e19a1b80 2024-09-11T00:53:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.591+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5610e19095b0 con 0x5610e19e3810 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41612/0 (socket says 172.21.15.81:41612) 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 -- 172.21.15.81:0/4102075236 learned_addr learned my addr 172.21.15.81:0/4102075236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b95400640 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19e3810 0x5610e19d9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 -- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19e3810 msgr2=0x5610e19d9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19e3810 0x5610e19d9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 -- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 msgr2=0x5610e19ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.592+0000 7f2b9e800640 1 -- 172.21.15.81:0/4102075236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e189e010 con 0x5610e199e910 2024-09-11T00:53:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009e40 tx=0x7f2b98010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c269b98f4c87283e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2b8ea00640 1 -- 172.21.15.81:0/4102075236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98016070 con 0x5610e199e910 2024-09-11T00:53:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2b8ea00640 1 -- 172.21.15.81:0/4102075236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b98004e10 con 0x5610e199e910 2024-09-11T00:53:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2b8ea00640 1 -- 172.21.15.81:0/4102075236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98005260 con 0x5610e199e910 2024-09-11T00:53:05.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 -- 172.21.15.81:0/4102075236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 msgr2=0x5610e19d98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009e40 tx=0x7f2b98010740 comp rx=0 tx=0).stop 2024-09-11T00:53:05.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 -- 172.21.15.81:0/4102075236 shutdown_connections 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e199e910 0x5610e19d98d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19e3810 0x5610e19d9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4102075236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.593+0000 7f2ba8097740 1 -- 172.21.15.81:0/4102075236 >> 172.21.15.81:0/4102075236 conn(0x5610e199fd60 msgr2=0x5610e19a1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.594+0000 7f2ba8097740 1 -- 172.21.15.81:0/4102075236 shutdown_connections 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.594+0000 7f2ba8097740 1 -- 172.21.15.81:0/4102075236 wait complete. 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.594+0000 7f2ba8097740 1 -- start start 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.594+0000 7f2ba8097740 1 Processor -- start 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5610e18acf70 con 0x5610e19e3810 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5610e18ab090 con 0x5610e19a1b80 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5610e19f8430 con 0x5610e19dc480 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.595+0000 7f2ba8097740 10 client.0 _ll_register_callbacks cb 0x5610e1614110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41628/0 (socket says 172.21.15.81:41628) 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 -- 172.21.15.81:0/2740966121 learned_addr learned my addr 172.21.15.81:0/2740966121 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b9e800640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b9de00640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 -- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 msgr2=0x5610e19f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 -- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 msgr2=0x5610e19e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 -- 172.21.15.81:0/2740966121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e1667ea0 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b9de00640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b95400640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b8802ab50 tx=0x7f2b88082b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8c8cb16aa0d801 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b83400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88049040 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2b8808c5e0 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.596+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b98004e10 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2b88083a60 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 10 client.5208 fetch_fsmap learned FSMap version 9 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5610e16e0d30 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b98004e10 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2b8808a0f0 con 0x5610e19e3810 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 10 client.5208 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 10 client.5208 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:53:05.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 20 client.5208 populate_metadata read hostname 'smithi081' 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e19a2fb0 0x5610e19a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 4 client.5208 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610e19182c0 con 0x5610e19a2fb0 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.597+0000 7f2b9de00640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e19a2fb0 0x5610e19a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.598+0000 7f2b83400640 10 client.5208 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.598+0000 7f2b9de00640 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e19a2fb0 0x5610e19a33b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f179576264ce73cd server_cookie=6541d5a6f55de762 in_seq=0 out_seq=0 2024-09-11T00:53:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.599+0000 7f2b83400640 1 -- 172.21.15.81:0/2740966121 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5610e19182c0 con 0x5610e19a2fb0 2024-09-11T00:53:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.599+0000 7f2b83400640 10 client.5208 handle_command_reply: tid=0 2024-09-11T00:53:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.599+0000 7f2ba8097740 1 client.5208 shutdown 2024-09-11T00:53:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.599+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 msgr2=0x5610e19d87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.599+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b8802ab50 tx=0x7f2b88082b90 comp rx=0 tx=0).stop 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 shutdown_connections 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e19a2fb0 0x5610e19a33b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e19d87c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 --2- 172.21.15.81:0/2740966121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19a1b80 0x5610e19e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 >> 172.21.15.81:0/2740966121 conn(0x5610e199e910 msgr2=0x5610e199cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2b83400640 0 client.5208 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 shutdown_connections 2024-09-11T00:53:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 1 -- 172.21.15.81:0/2740966121 wait complete. 2024-09-11T00:53:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.600+0000 7f2ba8097740 20 client.5208 trim_cache size 0 max 16384 2024-09-11T00:53:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 Processor -- start 2024-09-11T00:53:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 -- start start 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19e3810 0x5610e19a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01ff540 con 0x5610e19a1b80 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01fe420 con 0x5610e19e3810 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.618+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba01f4b60 con 0x5610e19dc480 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41630/0 (socket says 172.21.15.81:41630) 2024-09-11T00:53:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 -- 172.21.15.81:0/918741201 learned_addr learned my addr 172.21.15.81:0/918741201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 -- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 msgr2=0x5610e19a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 -- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19e3810 msgr2=0x5610e19a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19e3810 0x5610e19a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 -- 172.21.15.81:0/918741201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e19ecee0 con 0x5610e19a1b80 2024-09-11T00:53:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b9de00640 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b90010010 tx=0x7f2b90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f31251fea34df5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b8e000640 1 -- 172.21.15.81:0/918741201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9002d070 con 0x5610e19a1b80 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.619+0000 7f2b8e000640 1 -- 172.21.15.81:0/918741201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b90011530 con 0x5610e19a1b80 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2b8e000640 1 -- 172.21.15.81:0/918741201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90011980 con 0x5610e19a1b80 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 -- 172.21.15.81:0/918741201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 msgr2=0x5610e19dbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b90010010 tx=0x7f2b90015000 comp rx=0 tx=0).stop 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 -- 172.21.15.81:0/918741201 shutdown_connections 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19e3810 0x5610e19a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19dc480 0x5610e19a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 --2- 172.21.15.81:0/918741201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19a1b80 0x5610e19dbbb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 -- 172.21.15.81:0/918741201 >> 172.21.15.81:0/918741201 conn(0x5610e199e910 msgr2=0x5610e19e4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 -- 172.21.15.81:0/918741201 shutdown_connections 2024-09-11T00:53:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.620+0000 7f2ba8097740 1 -- 172.21.15.81:0/918741201 wait complete. 2024-09-11T00:53:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.621+0000 7f2ba8097740 1 -- start start 2024-09-11T00:53:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.621+0000 7f2ba8097740 1 Processor -- start 2024-09-11T00:53:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19a1b80 0x5610e19e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 0x5610e1a07480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01fd010 con 0x5610e19e3810 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01fdd50 con 0x5610e19dc480 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba01fd680 con 0x5610e19a1b80 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2ba8097740 10 client.0 _ll_register_callbacks cb 0x7f2b8807f200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41636/0 (socket says 172.21.15.81:41636) 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 -- 172.21.15.81:0/4222506852 learned_addr learned my addr 172.21.15.81:0/4222506852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9de00640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19a1b80 0x5610e19e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b95400640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 0x5610e1a07480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 -- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19a1b80 msgr2=0x5610e19e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19a1b80 0x5610e19e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 -- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 msgr2=0x5610e1a07480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 0x5610e1a07480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.622+0000 7f2b9e800640 1 -- 172.21.15.81:0/4222506852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e19f79a0 con 0x5610e19e3810 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b95400640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 0x5610e1a07480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b9e800640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5610e19a49f0 tx=0x7f2b98009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cdadaf1959c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b83400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98016070 con 0x5610e19e3810 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2b98012650 con 0x5610e19e3810 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b90011530 con 0x5610e19e3810 2024-09-11T00:53:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2b98012870 con 0x5610e19e3810 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2ba8097740 10 client.5214 fetch_fsmap learned FSMap version 9 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5610e19dd740 con 0x5610e19e3810 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.623+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b90011530 con 0x5610e19e3810 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2b9802c050 con 0x5610e19e3810 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 10 client.5214 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 10 client.5214 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 20 client.5214 populate_metadata read hostname 'smithi081' 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e1a5f490 0x5610e1a5f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 4 client.5214 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fc2e8ea2", "release": true, "await": true}] 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fc2e8ea2", "release": true, "await": true}) -- 0x5610e1913d70 con 0x5610e1a5f490 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.624+0000 7f2b9de00640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e1a5f490 0x5610e1a5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.625+0000 7f2b9de00640 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e1a5f490 0x5610e1a5f8a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff12e68c677d9d4 server_cookie=5c8e787128d24ad9 in_seq=0 out_seq=0 2024-09-11T00:53:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.625+0000 7f2b83400640 10 client.5214 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:05.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2b83400640 1 -- 172.21.15.81:0/4222506852 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5610e1913d70 con 0x5610e1a5f490 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2b83400640 10 client.5214 handle_command_reply: tid=0 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 client.5214 shutdown 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 msgr2=0x5610e1a080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5610e19a49f0 tx=0x7f2b98009d70 comp rx=0 tx=0).stop 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 shutdown_connections 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5610e1a5f490 0x5610e1a5f8a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5610e19e3810 0x5610e1a080c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5610e19dc480 0x5610e1a07480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 --2- 172.21.15.81:0/4222506852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5610e19a1b80 0x5610e19e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 >> 172.21.15.81:0/4222506852 conn(0x5610e199e910 msgr2=0x5610e19d8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2b83400640 0 client.5214 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 shutdown_connections 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 1 -- 172.21.15.81:0/4222506852 wait complete. 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.642+0000 7f2ba8097740 20 client.5214 trim_cache size 0 max 16384 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:53:05.645 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 28, 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "fc2e8ea2": { 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 28, 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:53:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:05.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:05.648 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:53:05.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 msgr2=0x7f2b7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 0x7f2b7c07a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005e00 tx=0x7f2b90005d50 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 msgr2=0x7f2ba0153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000c00 tx=0x7f2b88003910 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 shutdown_connections 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2b7c077f70 0x7f2b7c07a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba015baa0 0x7f2ba00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ba00c7360 0x7f2ba0153e40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 --2- 172.21.15.81:0/579147572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba006f760 0x7f2ba01f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 >> 172.21.15.81:0/579147572 conn(0x7f2ba006ff90 msgr2=0x7f2ba00725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 shutdown_connections 2024-09-11T00:53:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:05.643+0000 7f2ba5200640 1 -- 172.21.15.81:0/579147572 wait complete. 2024-09-11T00:53:05.662 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fc2e8ea2', total seconds elapsed: 29.1 2024-09-11T00:53:17.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:17.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:47.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:47.522 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:53:58.406 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.4 2024-09-11T00:53:58.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 -- 172.21.15.81:0/2258083250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c1548e0 msgr2=0x7fae2c15af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 --2- 172.21.15.81:0/2258083250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c1548e0 0x7fae2c15af30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fae20005fd0 tx=0x7fae2002a5c0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 -- 172.21.15.81:0/2258083250 shutdown_connections 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 --2- 172.21.15.81:0/2258083250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c0cbe90 0x7fae2c15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 --2- 172.21.15.81:0/2258083250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c1548e0 0x7fae2c15af30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 -- 172.21.15.81:0/2258083250 >> 172.21.15.81:0/2258083250 conn(0x7fae2c06ebb0 msgr2=0x7fae2c06efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 -- 172.21.15.81:0/2258083250 shutdown_connections 2024-09-11T00:53:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.583+0000 7fae32e00640 1 -- 172.21.15.81:0/2258083250 wait complete. 2024-09-11T00:53:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.585+0000 7fae32e00640 1 Processor -- start 2024-09-11T00:53:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.585+0000 7fae32e00640 1 -- start start 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 0x7fae2c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c1548e0 0x7fae2c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c15dd60 con 0x7fae2c0c4f50 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c0cb280 con 0x7fae2c0cbe90 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fae2c0cb5a0 con 0x7fae2c1548e0 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae31a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae31a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45816/0 (socket says 172.21.15.81:45816) 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae31a00640 1 -- 172.21.15.81:0/318358274 learned_addr learned my addr 172.21.15.81:0/318358274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae31000640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 0x7fae2c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.586+0000 7fae32400640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c1548e0 0x7fae2c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 -- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c1548e0 msgr2=0x7fae2c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c1548e0 0x7fae2c15cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 -- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 msgr2=0x7fae2c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 0x7fae2c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 -- 172.21.15.81:0/318358274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c15be40 con 0x7fae2c0c4f50 2024-09-11T00:53:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31000640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 0x7fae2c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:53:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae31a00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae20034040 tx=0x7fae200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2003e030 con 0x7fae2c0c4f50 2024-09-11T00:53:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae20003d90 con 0x7fae2c0c4f50 2024-09-11T00:53:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20035040 con 0x7fae2c0c4f50 2024-09-11T00:53:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.587+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c154010 con 0x7fae2c0c4f50 2024-09-11T00:53:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.588+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c15bb60 con 0x7fae2c0c4f50 2024-09-11T00:53:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.589+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c0c6ed0 con 0x7fae2c0c4f50 2024-09-11T00:53:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.590+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fae200049e0 con 0x7fae2c0c4f50 2024-09-11T00:53:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.591+0000 7fae29600640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 0x7fae0c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.591+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fae200bad70 con 0x7fae2c0c4f50 2024-09-11T00:53:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.591+0000 7fae31000640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 0x7fae0c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.592+0000 7fae31000640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 0x7fae0c07a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2c15da70 tx=0x7fae1800b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.595+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fae2c0c6ed0 con 0x7fae2c0c4f50 2024-09-11T00:53:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.849+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae2c15af30 con 0x7fae2c0c4f50 2024-09-11T00:53:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.849+0000 7fae29600640 1 -- 172.21.15.81:0/318358274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fae2c0cc760 con 0x7fae2c0c4f50 2024-09-11T00:53:58.851 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:53:58.851 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:53:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:53:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 msgr2=0x7fae0c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 0x7fae0c07a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae2c15da70 tx=0x7fae1800b390 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 msgr2=0x7fae2c1f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae20034040 tx=0x7fae200038a0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 shutdown_connections 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fae0c077f70 0x7fae0c07a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae2c1548e0 0x7fae2c15cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae2c0cbe90 0x7fae2c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 --2- 172.21.15.81:0/318358274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae2c0c4f50 0x7fae2c1f43f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 >> 172.21.15.81:0/318358274 conn(0x7fae2c06ebb0 msgr2=0x7fae2c1580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 shutdown_connections 2024-09-11T00:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:58.852+0000 7fae32e00640 1 -- 172.21.15.81:0/318358274 wait complete. 2024-09-11T00:53:58.870 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 153.4 --await-for 45.0' 2024-09-11T00:53:58.870 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 153.4 --await-for 45.0 2024-09-11T00:53:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 -- 172.21.15.81:0/1793027068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1194004070 msgr2=0x7f1194004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 --2- 172.21.15.81:0/1793027068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1194004070 0x7f1194004800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f119c009b20 tx=0x7f1194005830 comp rx=0 tx=0).stop 2024-09-11T00:53:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11afe00640 1 -- 172.21.15.81:0/1793027068 reap_dead start 2024-09-11T00:53:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 -- 172.21.15.81:0/1793027068 shutdown_connections 2024-09-11T00:53:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 -- 172.21.15.81:0/1793027068 >> 172.21.15.81:0/1793027068 conn(0x7f11b006d570 msgr2=0x7f11b00688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 -- 172.21.15.81:0/1793027068 shutdown_connections 2024-09-11T00:53:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.059+0000 7f11b6000640 1 -- 172.21.15.81:0/1793027068 wait complete. 2024-09-11T00:53:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.060+0000 7f11b6000640 1 Processor -- start 2024-09-11T00:53:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.061+0000 7f11b6000640 1 -- start start 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.061+0000 7f11b6000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1194004070 0x7f11b014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11b6000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b0150810 0x7f11b00b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11b6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11b6000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00cd030 con 0x7f11b00cfb10 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11b6000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00ccd50 con 0x7f11b0150810 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11b6000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f11b00c5010 con 0x7f1194004070 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45840/0 (socket says 172.21.15.81:45840) 2024-09-11T00:53:59.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 -- 172.21.15.81:0/3955839348 learned_addr learned my addr 172.21.15.81:0/3955839348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:59.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11af400640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1194004070 0x7f11b014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11aea00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b0150810 0x7f11b00b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 -- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1194004070 msgr2=0x7f11b014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1194004070 0x7f11b014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 -- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b0150810 msgr2=0x7f11b00b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b0150810 0x7f11b00b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.062+0000 7f11afe00640 1 -- 172.21.15.81:0/3955839348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b00cf4c0 con 0x7f11b00cfb10 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11afe00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b34c0 tx=0x7f11a800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11a7400640 1 -- 172.21.15.81:0/3955839348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004b20 con 0x7f11b00cfb10 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11a7400640 1 -- 172.21.15.81:0/3955839348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a8004cc0 con 0x7f11b00cfb10 2024-09-11T00:53:59.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b00cf7a0 con 0x7f11b00cfb10 2024-09-11T00:53:59.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11a7400640 1 -- 172.21.15.81:0/3955839348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8003bd0 con 0x7f11b00cfb10 2024-09-11T00:53:59.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.063+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b014dad0 con 0x7f11b00cfb10 2024-09-11T00:53:59.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.066+0000 7f11a7400640 1 -- 172.21.15.81:0/3955839348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f11a8018070 con 0x7f11b00cfb10 2024-09-11T00:53:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.067+0000 7f11b8ffd740 1 Processor -- start 2024-09-11T00:53:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.067+0000 7f11b8ffd740 1 -- start start 2024-09-11T00:53:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11a7400640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 0x7f119007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11a7400640 1 -- 172.21.15.81:0/3955839348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f11a809a600 con 0x7f11b00cfb10 2024-09-11T00:53:59.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11aea00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 0x7f119007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b236658650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b23668cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2365ca260 con 0x55b236651610 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b2365b9690 con 0x55b236657f10 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b2365bd4a0 con 0x55b2366959f0 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.068+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45844/0 (socket says 172.21.15.81:45844) 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 -- 172.21.15.81:0/3249467683 learned_addr learned my addr 172.21.15.81:0/3249467683 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11aea00640 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b236658650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11afe00640 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b23668cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 -- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 msgr2=0x55b23668cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b23668cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 -- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 msgr2=0x55b236658650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b236658650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 -- 172.21.15.81:0/3249467683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b236393d80 con 0x55b236651610 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11aea00640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 0x7f119007a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f119c035000 tx=0x7f119c02b970 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f11af400640 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11a0006d40 tx=0x7f11a0006490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b76adde2b63f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.069+0000 7f119b400640 1 -- 172.21.15.81:0/3249467683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0003dd0 con 0x55b236651610 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f119b400640 1 -- 172.21.15.81:0/3249467683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a0006e30 con 0x55b236651610 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f119b400640 1 -- 172.21.15.81:0/3249467683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0011690 con 0x55b236651610 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 -- 172.21.15.81:0/3249467683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 msgr2=0x55b2366519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11a0006d40 tx=0x7f11a0006490 comp rx=0 tx=0).stop 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 -- 172.21.15.81:0/3249467683 shutdown_connections 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b23668cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b236658650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/3249467683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236651610 0x55b2366519f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 -- 172.21.15.81:0/3249467683 >> 172.21.15.81:0/3249467683 conn(0x55b236653370 msgr2=0x55b236656c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 -- 172.21.15.81:0/3249467683 shutdown_connections 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.070+0000 7f11b8ffd740 1 -- 172.21.15.81:0/3249467683 wait complete. 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.071+0000 7f11b8ffd740 1 -- start start 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.071+0000 7f11b8ffd740 1 Processor -- start 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b2366ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b236329cc0 con 0x55b236657f10 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b23655ee60 con 0x55b236681470 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b236657350 con 0x55b2366959f0 2024-09-11T00:53:59.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.072+0000 7f11b8ffd740 10 client.0 _ll_register_callbacks cb 0x55b236565030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45854/0 (socket says 172.21.15.81:45854) 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 -- 172.21.15.81:0/2867811969 learned_addr learned my addr 172.21.15.81:0/2867811969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11aea00640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b2366ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11afe00640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 -- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 msgr2=0x55b2366ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b2366ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 -- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 msgr2=0x55b2366894e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366894e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11af400640 1 -- 172.21.15.81:0/2867811969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2363f4510 con 0x55b236657f10 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.073+0000 7f11aea00640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b2366ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f11af400640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f11a001c670 tx=0x7f11a001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47a4e5d8177e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f118fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00069d0 con 0x55b236657f10 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f11a001c9d0 con 0x55b236657f10 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a0006e30 con 0x55b236657f10 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f11a002e050 con 0x55b236657f10 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f11b8ffd740 10 client.5232 fetch_fsmap learned FSMap version 9 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b2362f8c20 con 0x55b236657f10 2024-09-11T00:53:59.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.074+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a0006e30 con 0x55b236657f10 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f11a0031020 con 0x55b236657f10 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 10 client.5232 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 10 client.5232 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 20 client.5232 populate_metadata read hostname 'smithi081' 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b236681850 0x55b236689ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 4 client.5232 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2365cc1b0 con 0x55b236681850 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.075+0000 7f11aea00640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b236681850 0x55b236689ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.076+0000 7f118fe00640 10 client.5232 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.076+0000 7f11aea00640 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b236681850 0x55b236689ef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94ec8f3219e2048 server_cookie=9e31dee63f7ccff1 in_seq=0 out_seq=0 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f118fe00640 1 -- 172.21.15.81:0/2867811969 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2365cc1b0 con 0x55b236681850 2024-09-11T00:53:59.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f118fe00640 10 client.5232 handle_command_reply: tid=0 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 client.5232 shutdown 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 msgr2=0x55b236688c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f11a001c670 tx=0x7f11a001c6a0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 shutdown_connections 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b236681850 0x55b236689ef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366894e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f118fe00640 0 client.5232 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b2366ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/2867811969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b236688c40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 >> 172.21.15.81:0/2867811969 conn(0x55b236651610 msgr2=0x55b236685680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 shutdown_connections 2024-09-11T00:53:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.077+0000 7f11b8ffd740 1 -- 172.21.15.81:0/2867811969 wait complete. 2024-09-11T00:53:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.078+0000 7f11b8ffd740 20 client.5232 trim_cache size 0 max 16384 2024-09-11T00:53:59.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.098+0000 7f11b8ffd740 1 Processor -- start 2024-09-11T00:53:59.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.098+0000 7f11b8ffd740 1 -- start start 2024-09-11T00:53:59.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b2366584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b236681470 0x55b2366543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01ffcb0 con 0x55b2366959f0 2024-09-11T00:53:59.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01feb90 con 0x55b236657f10 2024-09-11T00:53:59.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f11b0151aa0 con 0x55b236681470 2024-09-11T00:53:59.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45856/0 (socket says 172.21.15.81:45856) 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 -- 172.21.15.81:0/1115315178 learned_addr learned my addr 172.21.15.81:0/1115315178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11af400640 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b2366584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11aea00640 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b236681470 0x55b2366543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 -- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b236681470 msgr2=0x55b2366543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b236681470 0x55b2366543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 -- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 msgr2=0x55b2366584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b2366584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.099+0000 7f11afe00640 1 -- 172.21.15.81:0/1115315178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b236653760 con 0x55b2366959f0 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.100+0000 7f11afe00640 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11a80624d0 tx=0x7f11a805ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57adc1bdc25f9b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.100+0000 7f119aa00640 1 -- 172.21.15.81:0/1115315178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a801d040 con 0x55b2366959f0 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.100+0000 7f119aa00640 1 -- 172.21.15.81:0/1115315178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a806bc20 con 0x55b2366959f0 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.100+0000 7f119aa00640 1 -- 172.21.15.81:0/1115315178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8098be0 con 0x55b2366959f0 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- 172.21.15.81:0/1115315178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 msgr2=0x55b2366548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11a80624d0 tx=0x7f11a805ef40 comp rx=0 tx=0).stop 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- 172.21.15.81:0/1115315178 shutdown_connections 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2366959f0 0x55b2366548f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b236681470 0x55b2366543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/1115315178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236657f10 0x55b2366584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- 172.21.15.81:0/1115315178 >> 172.21.15.81:0/1115315178 conn(0x55b236651610 msgr2=0x55b236684480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- 172.21.15.81:0/1115315178 shutdown_connections 2024-09-11T00:53:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- 172.21.15.81:0/1115315178 wait complete. 2024-09-11T00:53:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.101+0000 7f11b8ffd740 1 -- start start 2024-09-11T00:53:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.102+0000 7f11b8ffd740 1 Processor -- start 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366ae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b236654b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01fd800 con 0x55b236657f10 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11b01fe4c0 con 0x55b236681470 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f11b01fde50 con 0x55b2366959f0 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11b8ffd740 10 client.0 _ll_register_callbacks cb 0x7f11a0006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:53:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45860/0 (socket says 172.21.15.81:45860) 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 -- 172.21.15.81:0/4006447747 learned_addr learned my addr 172.21.15.81:0/4006447747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11aea00640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11afe00640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b236654b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 -- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 msgr2=0x55b236654b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b236654b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 -- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 msgr2=0x55b2366ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.103+0000 7f11af400640 1 -- 172.21.15.81:0/4006447747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b236695f70 con 0x55b236657f10 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f11af400640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f11a00065e0 tx=0x7f11a0006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3bf492b57e5a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:53:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f118fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0015040 con 0x55b236657f10 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f11a001c070 con 0x55b236657f10 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a806bc20 con 0x55b236657f10 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f11a00039c0 con 0x55b236657f10 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f11b8ffd740 10 client.5238 fetch_fsmap learned FSMap version 9 2024-09-11T00:53:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b2366544e0 con 0x55b236657f10 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.104+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a806bc20 con 0x55b236657f10 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f11a0031040 con 0x55b236657f10 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 10 client.5238 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 10 client.5238 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 20 client.5238 populate_metadata read hostname 'smithi081' 2024-09-11T00:53:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2366ae5a0 0x55b236655080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:53:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 4 client.5238 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.4, "await_for": 45.0}] 2024-09-11T00:53:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.4, "await_for": 45.0}) -- 0x55b2365c7c60 con 0x55b2366ae5a0 2024-09-11T00:53:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11aea00640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2366ae5a0 0x55b236655080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:53:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f11aea00640 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2366ae5a0 0x55b236655080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74c651093cf717a server_cookie=2ad9947539dd7812 in_seq=0 out_seq=0 2024-09-11T00:53:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.105+0000 7f118fe00640 10 client.5238 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f118fe00640 1 -- 172.21.15.81:0/4006447747 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b2365c7c60 con 0x55b2366ae5a0 2024-09-11T00:53:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f118fe00640 10 client.5238 handle_command_reply: tid=0 2024-09-11T00:53:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 client.5238 shutdown 2024-09-11T00:53:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 msgr2=0x55b23671c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f11a00065e0 tx=0x7f11a0006720 comp rx=0 tx=0).stop 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 shutdown_connections 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2366ae5a0 0x55b236655080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2366959f0 0x55b236654b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b236681470 0x55b2366ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f118fe00640 0 client.5238 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 --2- 172.21.15.81:0/4006447747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b236657f10 0x55b23671c3a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.188+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 >> 172.21.15.81:0/4006447747 conn(0x55b236651610 msgr2=0x55b236652930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 shutdown_connections 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b8ffd740 1 -- 172.21.15.81:0/4006447747 wait complete. 2024-09-11T00:53:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b8ffd740 20 client.5238 trim_cache size 0 max 16384 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 30, 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "e537d88d": { 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 30, 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:53:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 153.4, 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:53:59.194 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:53:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 msgr2=0x7f119007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 0x7f119007a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f119c035000 tx=0x7f119c02b970 comp rx=0 tx=0).stop 2024-09-11T00:53:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 msgr2=0x7f11b01f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b34c0 tx=0x7f11a800f3c0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 shutdown_connections 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1190077f70 0x7f119007a430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b00cfb10 0x7f11b01f3eb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b0150810 0x7f11b00b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 --2- 172.21.15.81:0/3955839348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1194004070 0x7f11b014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.189+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 >> 172.21.15.81:0/3955839348 conn(0x7f11b006d570 msgr2=0x7f11b0158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.190+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 shutdown_connections 2024-09-11T00:53:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:53:59.190+0000 7f11b6000640 1 -- 172.21.15.81:0/3955839348 wait complete. 2024-09-11T00:53:59.206 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e537d88d', quiesce took 0.8 seconds. Will release after: 32.6 2024-09-11T00:54:17.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:54:17.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:54:31.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 -- 172.21.15.81:0/1751670723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8074860 msgr2=0x7fcfa80c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 --2- 172.21.15.81:0/1751670723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8074860 0x7fcfa80c7980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcfa815c630 tx=0x7fcf9002a5a0 comp rx=0 tx=0).stop 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 -- 172.21.15.81:0/1751670723 shutdown_connections 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 --2- 172.21.15.81:0/1751670723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8074860 0x7fcfa80c7980 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 --2- 172.21.15.81:0/1751670723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8152610 0x7fcfa80c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 -- 172.21.15.81:0/1751670723 >> 172.21.15.81:0/1751670723 conn(0x7fcfa80700f0 msgr2=0x7fcfa8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 -- 172.21.15.81:0/1751670723 shutdown_connections 2024-09-11T00:54:31.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.972+0000 7fcfade00640 1 -- 172.21.15.81:0/1751670723 wait complete. 2024-09-11T00:54:31.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.974+0000 7fcfade00640 1 Processor -- start 2024-09-11T00:54:31.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.974+0000 7fcfade00640 1 -- start start 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8074860 0x7fcfa8155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 0x7fcfa8154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa8070cf0 con 0x7fcfa8152610 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa815c140 con 0x7fcfa814b730 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfade00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa81529f0 con 0x7fcfa8074860 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfa6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfa6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53610/0 (socket says 172.21.15.81:53610) 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfa6000640 1 -- 172.21.15.81:0/3790750676 learned_addr learned my addr 172.21.15.81:0/3790750676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfa6a00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8074860 0x7fcfa8155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.975+0000 7fcfa7400640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 0x7fcfa8154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 -- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8074860 msgr2=0x7fcfa8155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8074860 0x7fcfa8155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 -- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 msgr2=0x7fcfa8154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 0x7fcfa8154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 -- 172.21.15.81:0/3790750676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa8159d10 con 0x7fcfa8152610 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa7400640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 0x7fcfa8154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfa6000640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf9002ab90 tx=0x7fcf90032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90040070 con 0x7fcfa8152610 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf90005310 con 0x7fcfa8152610 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90003800 con 0x7fcfa8152610 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa8159ff0 con 0x7fcfa8152610 2024-09-11T00:54:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.976+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa8159970 con 0x7fcfa8152610 2024-09-11T00:54:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.977+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa80b22f0 con 0x7fcfa8152610 2024-09-11T00:54:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.978+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf900039a0 con 0x7fcfa8152610 2024-09-11T00:54:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.979+0000 7fcf9f400640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 0x7fcf8407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.979+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fcf900bb620 con 0x7fcfa8152610 2024-09-11T00:54:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.980+0000 7fcfa6a00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 0x7fcf8407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.980+0000 7fcfa6a00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 0x7fcf8407a460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ae50 tx=0x7fcf9800a540 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:31.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:31.983+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcfa80b22f0 con 0x7fcfa8152610 2024-09-11T00:54:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.203+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfa80c2ea0 con 0x7fcfa8152610 2024-09-11T00:54:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.203+0000 7fcf9f400640 1 -- 172.21.15.81:0/3790750676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fcf90083da0 con 0x7fcfa8152610 2024-09-11T00:54:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:54:32.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:54:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:54:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 msgr2=0x7fcf8407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 0x7fcf8407a460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ae50 tx=0x7fcf9800a540 comp rx=0 tx=0).stop 2024-09-11T00:54:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 msgr2=0x7fcfa81548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf9002ab90 tx=0x7fcf90032d50 comp rx=0 tx=0).stop 2024-09-11T00:54:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 shutdown_connections 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fcf84077fa0 0x7fcf8407a460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfa814b730 0x7fcfa8154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa8152610 0x7fcfa81548a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 --2- 172.21.15.81:0/3790750676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfa8074860 0x7fcfa8155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 >> 172.21.15.81:0/3790750676 conn(0x7fcfa80700f0 msgr2=0x7fcfa80c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 shutdown_connections 2024-09-11T00:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.206+0000 7fcfade00640 1 -- 172.21.15.81:0/3790750676 wait complete. 2024-09-11T00:54:32.223 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id e537d88d --release --await' 2024-09-11T00:54:32.223 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id e537d88d --release --await 2024-09-11T00:54:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.387+0000 7f9144a00640 1 -- 172.21.15.81:0/3496402128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f914015daf0 msgr2=0x7f91400cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.387+0000 7f9144a00640 1 --2- 172.21.15.81:0/3496402128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f914015daf0 0x7f91400cbaf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f914008d740 tx=0x7f912c02a5f0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 -- 172.21.15.81:0/3496402128 shutdown_connections 2024-09-11T00:54:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 --2- 172.21.15.81:0/3496402128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f914015daf0 0x7f91400cbaf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 --2- 172.21.15.81:0/3496402128 >> v2:172.21.15.167:3300/0 conn(0x7f91400c9ca0 0x7f914006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 -- 172.21.15.81:0/3496402128 >> 172.21.15.81:0/3496402128 conn(0x7f9140068d00 msgr2=0x7f9140069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 -- 172.21.15.81:0/3496402128 shutdown_connections 2024-09-11T00:54:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.388+0000 7f9144a00640 1 -- 172.21.15.81:0/3496402128 wait complete. 2024-09-11T00:54:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.389+0000 7f9144a00640 1 Processor -- start 2024-09-11T00:54:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.389+0000 7f9144a00640 1 -- start start 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400ccff0 0x7f91400c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 0x7f9140159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91400cc6a0 con 0x7f91400c9ca0 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f914006d070 con 0x7f91400ccff0 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f9144a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91400ca080 con 0x7f914015daf0 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.390+0000 7f913f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53622/0 (socket says 172.21.15.81:53622) 2024-09-11T00:54:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 -- 172.21.15.81:0/347038841 learned_addr learned my addr 172.21.15.81:0/347038841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913ea00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400ccff0 0x7f91400c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913fe00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 0x7f9140159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 -- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 msgr2=0x7f9140159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 0x7f9140159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 -- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400ccff0 msgr2=0x7f91400c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400ccff0 0x7f91400c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 -- 172.21.15.81:0/347038841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401f1630 con 0x7f91400c9ca0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913fe00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 0x7f9140159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.391+0000 7f913f400640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f913000d6d0 tx=0x7f913000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.392+0000 7f9137400640 1 -- 172.21.15.81:0/347038841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130017070 con 0x7f91400c9ca0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.392+0000 7f9137400640 1 -- 172.21.15.81:0/347038841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9130005330 con 0x7f91400c9ca0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.392+0000 7f9137400640 1 -- 172.21.15.81:0/347038841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130009820 con 0x7f91400c9ca0 2024-09-11T00:54:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.392+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914015c900 con 0x7f91400c9ca0 2024-09-11T00:54:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.392+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91401f0d90 con 0x7f91400c9ca0 2024-09-11T00:54:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.394+0000 7f9137400640 1 -- 172.21.15.81:0/347038841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9130009bd0 con 0x7f91400c9ca0 2024-09-11T00:54:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.395+0000 7f9137400640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 0x7f912007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.395+0000 7f9137400640 1 -- 172.21.15.81:0/347038841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f913009a3f0 con 0x7f91400c9ca0 2024-09-11T00:54:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.395+0000 7f9149069740 1 Processor -- start 2024-09-11T00:54:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.395+0000 7f913ea00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 0x7f912007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.395+0000 7f9149069740 1 -- start start 2024-09-11T00:54:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f913ea00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 0x7f912007a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f912c033000 tx=0x7f912c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccb4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc66b20 0x55634cca1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55634cbde370 con 0x55634ccaba20 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55634cbcd7a0 con 0x55634cc66b20 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.396+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55634cbd15b0 con 0x55634cc69d90 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53630/0 (socket says 172.21.15.81:53630) 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 -- 172.21.15.81:0/2919044439 learned_addr learned my addr 172.21.15.81:0/2919044439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913fe00640 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc66b20 0x55634cca1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913f400640 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccb4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 -- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 msgr2=0x55634ccb4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccb4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 -- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc66b20 msgr2=0x55634cca1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc66b20 0x55634cca1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 -- 172.21.15.81:0/2919044439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634cb66010 con 0x55634ccaba20 2024-09-11T00:54:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.397+0000 7f913ea00640 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f912c000c00 tx=0x7f912c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd68b7af5670002 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f912b400640 1 -- 172.21.15.81:0/2919044439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c035040 con 0x55634ccaba20 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f912b400640 1 -- 172.21.15.81:0/2919044439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c04e070 con 0x55634ccaba20 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f912b400640 1 -- 172.21.15.81:0/2919044439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0496e0 con 0x55634ccaba20 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 -- 172.21.15.81:0/2919044439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 msgr2=0x55634cca15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f912c000c00 tx=0x7f912c03d000 comp rx=0 tx=0).stop 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 -- 172.21.15.81:0/2919044439 shutdown_connections 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc66b20 0x55634cca1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634ccaba20 0x55634cca15a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 --2- 172.21.15.81:0/2919044439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccb4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 -- 172.21.15.81:0/2919044439 >> 172.21.15.81:0/2919044439 conn(0x55634cc67f70 msgr2=0x55634cc69450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 -- 172.21.15.81:0/2919044439 shutdown_connections 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.398+0000 7f9149069740 1 -- 172.21.15.81:0/2919044439 wait complete. 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.399+0000 7f9149069740 1 -- start start 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.399+0000 7f9149069740 1 Processor -- start 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccadc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634ccaba20 0x55634cca6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55634cb74f70 con 0x55634cca63f0 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55634cb73090 con 0x55634ccaba20 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55634cca7a30 con 0x55634cc69d90 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.400+0000 7f9149069740 10 client.0 _ll_register_callbacks cb 0x55634c8dc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53636/0 (socket says 172.21.15.81:53636) 2024-09-11T00:54:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 -- 172.21.15.81:0/2836835296 learned_addr learned my addr 172.21.15.81:0/2836835296 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913f400640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccadc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913ea00640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634ccaba20 0x55634cca6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 -- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 msgr2=0x55634ccadc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccadc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 -- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634ccaba20 msgr2=0x55634cca6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634ccaba20 0x55634cca6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 -- 172.21.15.81:0/2836835296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634c92fea0 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f913fe00640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f913800ce60 tx=0x7f9138007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418a0c0a1611e2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.401+0000 7f911fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138017620 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912c04e070 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f91380177c0 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9138023050 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 10 client.5259 fetch_fsmap learned FSMap version 9 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55634c9a8d30 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c04e070 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9138026020 con 0x55634cca63f0 2024-09-11T00:54:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 10 client.5259 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 10 client.5259 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 20 client.5259 populate_metadata read hostname 'smithi081' 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cca74a0 0x55634ccb0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 4 client.5259 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.402+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55634cbe02c0 con 0x55634cca74a0 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.403+0000 7f913f400640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cca74a0 0x55634ccb0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.403+0000 7f911fe00640 10 client.5259 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.403+0000 7f913f400640 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cca74a0 0x55634ccb0c50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c648317ac23358c9 server_cookie=82e8cc4977d6fb92 in_seq=0 out_seq=0 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f911fe00640 1 -- 172.21.15.81:0/2836835296 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55634cbe02c0 con 0x55634cca74a0 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f911fe00640 10 client.5259 handle_command_reply: tid=0 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 client.5259 shutdown 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 msgr2=0x55634ccb0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f913800ce60 tx=0x7f9138007660 comp rx=0 tx=0).stop 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 shutdown_connections 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cca74a0 0x55634ccb0c50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccb0240 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634ccaba20 0x55634cca6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 --2- 172.21.15.81:0/2836835296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634cc69d90 0x55634ccadc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 >> 172.21.15.81:0/2836835296 conn(0x55634cc66b20 msgr2=0x55634cc68f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.404+0000 7f911fe00640 0 client.5259 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.405+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 shutdown_connections 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.405+0000 7f9149069740 1 -- 172.21.15.81:0/2836835296 wait complete. 2024-09-11T00:54:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.405+0000 7f9149069740 20 client.5259 trim_cache size 0 max 16384 2024-09-11T00:54:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.422+0000 7f9149069740 1 Processor -- start 2024-09-11T00:54:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.422+0000 7f9149069740 1 -- start start 2024-09-11T00:54:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634ccacd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634ccd0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91401ff180 con 0x55634cca63f0 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91401fe060 con 0x55634cc69d90 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91401f47d0 con 0x55634ccaba20 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53648/0 (socket says 172.21.15.81:53648) 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f913ea00640 1 -- 172.21.15.81:0/3824794200 learned_addr learned my addr 172.21.15.81:0/3824794200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.423+0000 7f913fe00640 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634ccd0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913f400640 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634ccacd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 -- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 msgr2=0x55634ccd0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634ccd0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 -- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 msgr2=0x55634ccacd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634ccacd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 -- 172.21.15.81:0/3824794200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634cca72d0 con 0x55634cca63f0 2024-09-11T00:54:32.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f913ea00640 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f912c02a630 tx=0x7f912c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50a71af8d35684e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f912aa00640 1 -- 172.21.15.81:0/3824794200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c05b070 con 0x55634cca63f0 2024-09-11T00:54:32.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f912aa00640 1 -- 172.21.15.81:0/3824794200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c04e050 con 0x55634cca63f0 2024-09-11T00:54:32.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.424+0000 7f912aa00640 1 -- 172.21.15.81:0/3824794200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c035040 con 0x55634cca63f0 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 -- 172.21.15.81:0/3824794200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 msgr2=0x55634ccd0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f912c02a630 tx=0x7f912c0046c0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 -- 172.21.15.81:0/3824794200 shutdown_connections 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634ccd0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634ccd0730 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 --2- 172.21.15.81:0/3824794200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634ccacd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 -- 172.21.15.81:0/3824794200 >> 172.21.15.81:0/3824794200 conn(0x55634cc66b20 msgr2=0x55634cca7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 -- 172.21.15.81:0/3824794200 shutdown_connections 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.425+0000 7f9149069740 1 -- 172.21.15.81:0/3824794200 wait complete. 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.426+0000 7f9149069740 1 -- start start 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.426+0000 7f9149069740 1 Processor -- start 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634cc96180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634cd27590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91401fccd0 con 0x55634cca63f0 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91401fd990 con 0x55634cc69d90 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91401fd320 con 0x55634ccaba20 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f9149069740 10 client.0 _ll_register_callbacks cb 0x7f9138009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53656/0 (socket says 172.21.15.81:53656) 2024-09-11T00:54:32.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 -- 172.21.15.81:0/1141295440 learned_addr learned my addr 172.21.15.81:0/1141295440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913f400640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634cc96180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 -- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 msgr2=0x55634cd27590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634cd27590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 -- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 msgr2=0x55634cc96180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634cc96180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913ea00640 1 -- 172.21.15.81:0/1141295440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634ccb0fc0 con 0x55634cca63f0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.427+0000 7f913f400640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634cc96180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f913ea00640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f912c02a630 tx=0x7f912c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec20989eefa2a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c065060 con 0x55634cca63f0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f912c049980 con 0x55634cca63f0 2024-09-11T00:54:32.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912c04e050 con 0x55634cca63f0 2024-09-11T00:54:32.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f912c06b050 con 0x55634cca63f0 2024-09-11T00:54:32.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f9149069740 10 client.5265 fetch_fsmap learned FSMap version 9 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55634ccb52d0 con 0x55634cca63f0 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c04e050 con 0x55634cca63f0 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.428+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f912c06e020 con 0x55634cca63f0 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 10 client.5265 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 10 client.5265 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 20 client.5265 populate_metadata read hostname 'smithi081' 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cc93c10 0x55634cd27ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 4 client.5265 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e537d88d", "release": true, "await": true}] 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e537d88d", "release": true, "await": true}) -- 0x55634cbdbd70 con 0x55634cc93c10 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.429+0000 7f913f400640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cc93c10 0x55634cd27ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.430+0000 7f911fe00640 10 client.5265 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:54:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.430+0000 7f913f400640 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cc93c10 0x55634cd27ad0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680765e3db489136 server_cookie=ae8e5c14ce481d50 in_seq=0 out_seq=0 2024-09-11T00:54:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f911fe00640 1 -- 172.21.15.81:0/1141295440 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55634cbdbd70 con 0x55634cc93c10 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f911fe00640 10 client.5265 handle_command_reply: tid=0 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 client.5265 shutdown 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 msgr2=0x55634cd31190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f912c02a630 tx=0x7f912c005880 comp rx=0 tx=0).stop 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 shutdown_connections 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55634cc93c10 0x55634cd27ad0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55634ccaba20 0x55634cd27590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55634cca63f0 0x55634cd31190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 --2- 172.21.15.81:0/1141295440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55634cc69d90 0x55634cc96180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f911fe00640 0 client.5265 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 >> 172.21.15.81:0/1141295440 conn(0x55634cc66b20 msgr2=0x55634cc65e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 shutdown_connections 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 1 -- 172.21.15.81:0/1141295440 wait complete. 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.448+0000 7f9149069740 20 client.5265 trim_cache size 0 max 16384 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 32, 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "e537d88d": { 2024-09-11T00:54:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 32, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 153.4, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:54:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:54:32.454 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 msgr2=0x7f912007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 0x7f912007a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f912c033000 tx=0x7f912c004730 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 msgr2=0x7f914015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f913000d6d0 tx=0x7f913000db90 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 shutdown_connections 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9120077f70 0x7f912007a430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f914015daf0 0x7f9140159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400ccff0 0x7f91400c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 --2- 172.21.15.81:0/347038841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91400c9ca0 0x7f914015bed0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 >> 172.21.15.81:0/347038841 conn(0x7f9140068d00 msgr2=0x7f91400ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 shutdown_connections 2024-09-11T00:54:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:54:32.449+0000 7f9144a00640 1 -- 172.21.15.81:0/347038841 wait complete. 2024-09-11T00:54:32.467 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e537d88d', total seconds elapsed: 34.1 2024-09-11T00:54:47.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:54:47.722 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:55:17.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:55:17.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:55:34.496 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:55:34.497 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.4 2024-09-11T00:55:34.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 -- 172.21.15.81:0/3254739433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc150e50 msgr2=0x7f80dc0cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3254739433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc150e50 0x7f80dc0cb450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009830 tx=0x7f80d002a530 comp rx=0 tx=0).stop 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 -- 172.21.15.81:0/3254739433 shutdown_connections 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3254739433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc150e50 0x7f80dc0cb450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 -- 172.21.15.81:0/3254739433 >> 172.21.15.81:0/3254739433 conn(0x7f80dc06cd90 msgr2=0x7f80dc06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 -- 172.21.15.81:0/3254739433 shutdown_connections 2024-09-11T00:55:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.667+0000 7f80e2a00640 1 -- 172.21.15.81:0/3254739433 wait complete. 2024-09-11T00:55:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.669+0000 7f80e2a00640 1 Processor -- start 2024-09-11T00:55:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.669+0000 7f80e2a00640 1 -- start start 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80dc150e50 0x7f80dc14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 0x7f80dc1e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc15b2e0 con 0x7f80dc0c5360 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0caa60 con 0x7f80dc15aec0 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.670+0000 7f80e2a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc151230 con 0x7f80dc150e50 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56034/0 (socket says 172.21.15.81:56034) 2024-09-11T00:55:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 -- 172.21.15.81:0/3004786669 learned_addr learned my addr 172.21.15.81:0/3004786669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e2000640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 0x7f80dc1e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e0c00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80dc150e50 0x7f80dc14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 -- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80dc150e50 msgr2=0x7f80dc14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80dc150e50 0x7f80dc14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 -- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 msgr2=0x7f80dc1e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 0x7f80dc1e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 -- 172.21.15.81:0/3004786669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc1e3940 con 0x7f80dc0c5360 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e2000640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 0x7f80dc1e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.671+0000 7f80e1600640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009950 tx=0x7f80d0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.672+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0040070 con 0x7f80dc0c5360 2024-09-11T00:55:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.672+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d0003af0 con 0x7f80dc0c5360 2024-09-11T00:55:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.672+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0045460 con 0x7f80dc0c5360 2024-09-11T00:55:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.672+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc0c9cd0 con 0x7f80dc0c5360 2024-09-11T00:55:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.672+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc1e3e90 con 0x7f80dc0c5360 2024-09-11T00:55:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.673+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc1f3750 con 0x7f80dc0c5360 2024-09-11T00:55:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.675+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f80d0045600 con 0x7f80dc0c5360 2024-09-11T00:55:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.676+0000 7f80d9600640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 0x7f80bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.676+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f80d00bba50 con 0x7f80dc0c5360 2024-09-11T00:55:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.676+0000 7f80e0c00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 0x7f80bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.677+0000 7f80e0c00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 0x7f80bc07a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80dc075b40 tx=0x7f80c8009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.681+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f80dc1f3750 con 0x7f80dc0c5360 2024-09-11T00:55:34.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.955+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80dc0cc7f0 con 0x7f80dc0c5360 2024-09-11T00:55:34.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.956+0000 7f80d9600640 1 -- 172.21.15.81:0/3004786669 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f80d0084e20 con 0x7f80dc0c5360 2024-09-11T00:55:34.957 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:55:34.957 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:55:34.958 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 msgr2=0x7f80bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 0x7f80bc07a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80dc075b40 tx=0x7f80c8009040 comp rx=0 tx=0).stop 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 msgr2=0x7f80dc151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009950 tx=0x7f80d0032d50 comp rx=0 tx=0).stop 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 shutdown_connections 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f80bc077f70 0x7f80bc07a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80dc15aec0 0x7f80dc1e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80dc150e50 0x7f80dc14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 --2- 172.21.15.81:0/3004786669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80dc0c5360 0x7f80dc151650 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 >> 172.21.15.81:0/3004786669 conn(0x7f80dc06cd90 msgr2=0x7f80dc150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.958+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 shutdown_connections 2024-09-11T00:55:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:34.959+0000 7f80e2a00640 1 -- 172.21.15.81:0/3004786669 wait complete. 2024-09-11T00:55:34.977 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0' 2024-09-11T00:55:34.977 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 -- 172.21.15.81:0/3835268756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 msgr2=0x7f28500c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 --2- 172.21.15.81:0/3835268756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c5e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2848005fd0 tx=0x7f284802a9d0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 -- 172.21.15.81:0/3835268756 shutdown_connections 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 --2- 172.21.15.81:0/3835268756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c5e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 -- 172.21.15.81:0/3835268756 >> 172.21.15.81:0/3835268756 conn(0x7f28500688e0 msgr2=0x7f2850068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 -- 172.21.15.81:0/3835268756 shutdown_connections 2024-09-11T00:55:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.160+0000 7f2855e00640 1 -- 172.21.15.81:0/3835268756 wait complete. 2024-09-11T00:55:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.162+0000 7f2855e00640 1 Processor -- start 2024-09-11T00:55:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.162+0000 7f2855e00640 1 -- start start 2024-09-11T00:55:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.163+0000 7f2855e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2850154810 0x7f28500ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f285015a500 con 0x7f28500cc030 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f285015b0b0 con 0x7f28500c5670 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28500cb500 con 0x7f2850154810 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56048/0 (socket says 172.21.15.81:56048) 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 -- 172.21.15.81:0/3024914514 learned_addr learned my addr 172.21.15.81:0/3024914514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2854a00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f2855400640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2850154810 0x7f28500ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 -- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2850154810 msgr2=0x7f28500ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2850154810 0x7f28500ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 -- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 msgr2=0x7f28500c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.164+0000 7f284fe00640 1 -- 172.21.15.81:0/3024914514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500cf840 con 0x7f28500cc030 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f284fe00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c4c0 tx=0x7f283c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f284cc00640 1 -- 172.21.15.81:0/3024914514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c017070 con 0x7f28500cc030 2024-09-11T00:55:35.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f284cc00640 1 -- 172.21.15.81:0/3024914514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f283c0035f0 con 0x7f28500cc030 2024-09-11T00:55:35.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28500cfb20 con 0x7f28500cc030 2024-09-11T00:55:35.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f284cc00640 1 -- 172.21.15.81:0/3024914514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c003a00 con 0x7f28500cc030 2024-09-11T00:55:35.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.165+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28500cde80 con 0x7f28500cc030 2024-09-11T00:55:35.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.167+0000 7f284cc00640 1 -- 172.21.15.81:0/3024914514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f283c003ba0 con 0x7f28500cc030 2024-09-11T00:55:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.168+0000 7f284cc00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 0x7f283007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.168+0000 7f284cc00640 1 -- 172.21.15.81:0/3024914514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f283c099690 con 0x7f28500cc030 2024-09-11T00:55:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.169+0000 7f2854a00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 0x7f283007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.169+0000 7f285a3ee740 1 Processor -- start 2024-09-11T00:55:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.169+0000 7f285a3ee740 1 -- start start 2024-09-11T00:55:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.169+0000 7f2854a00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 0x7f283007a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2844001720 tx=0x7f2844009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 0x5641e4656ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e4691d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641e45cf260 con 0x5641e465d0c0 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641e45be690 con 0x5641e46567c0 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5641e45c24a0 con 0x5641e469aba0 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f284fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f2855400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e4691d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f284fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56058/0 (socket says 172.21.15.81:56058) 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f284fe00640 1 -- 172.21.15.81:0/82097400 learned_addr learned my addr 172.21.15.81:0/82097400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f2855400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e4691d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:50496/0 (socket says 172.21.15.81:50496) 2024-09-11T00:55:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.170+0000 7f2854a00640 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 0x5641e4656ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 -- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 msgr2=0x5641e4691d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e4691d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 -- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 msgr2=0x5641e4656ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 0x5641e4656ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 -- 172.21.15.81:0/82097400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e4398d80 con 0x5641e465d0c0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f2854a00640 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 0x5641e4656ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f284fe00640 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f283c097780 tx=0x7f283c060f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da5f55a5e895d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f2841200640 1 -- 172.21.15.81:0/82097400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c0661f0 con 0x5641e465d0c0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f2841200640 1 -- 172.21.15.81:0/82097400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f283c06ac10 con 0x5641e465d0c0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.171+0000 7f2841200640 1 -- 172.21.15.81:0/82097400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c06a9e0 con 0x5641e465d0c0 2024-09-11T00:55:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 -- 172.21.15.81:0/82097400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 msgr2=0x5641e465d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f283c097780 tx=0x7f283c060f30 comp rx=0 tx=0).stop 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 -- 172.21.15.81:0/82097400 shutdown_connections 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e4691d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e465d800 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 --2- 172.21.15.81:0/82097400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e46567c0 0x5641e4656ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 -- 172.21.15.81:0/82097400 >> 172.21.15.81:0/82097400 conn(0x5641e4658520 msgr2=0x5641e465bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 -- 172.21.15.81:0/82097400 shutdown_connections 2024-09-11T00:55:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.172+0000 7f285a3ee740 1 -- 172.21.15.81:0/82097400 wait complete. 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.173+0000 7f285a3ee740 1 -- start start 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.173+0000 7f285a3ee740 1 Processor -- start 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e465a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46838c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641e432ecc0 con 0x5641e4699c40 2024-09-11T00:55:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641e4563e60 con 0x5641e465d0c0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5641e465c500 con 0x5641e469aba0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f285a3ee740 10 client.0 _ll_register_callbacks cb 0x5641e456a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.174+0000 7f2855400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56062/0 (socket says 172.21.15.81:56062) 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 -- 172.21.15.81:0/1337386680 learned_addr learned my addr 172.21.15.81:0/1337386680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2854a00640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e465a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f284fe00640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 -- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 msgr2=0x5641e46838c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46838c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 -- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 msgr2=0x5641e465a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e465a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 -- 172.21.15.81:0/1337386680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e43f9510 con 0x5641e4699c40 2024-09-11T00:55:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2855400640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ca0 tx=0x7f2848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd6f4f1ab7d1fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.175+0000 7f2835600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848044480 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283c06ac10 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2848044620 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2848050050 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 10 client.5283 fetch_fsmap learned FSMap version 9 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5641e42fdc20 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f283c06ac10 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2848053020 con 0x5641e4699c40 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 10 client.5283 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 10 client.5283 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 20 client.5283 populate_metadata read hostname 'smithi081' 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e4684d40 0x5641e4685180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 4 client.5283 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:55:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.176+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641e45d11b0 con 0x5641e4684d40 2024-09-11T00:55:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.177+0000 7f2854a00640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e4684d40 0x5641e4685180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.178+0000 7f2854a00640 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e4684d40 0x5641e4685180 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d15648bdaa52124 server_cookie=c9e91159a1432ff8 in_seq=0 out_seq=0 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.178+0000 7f2835600640 10 client.5283 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.178+0000 7f2835600640 1 -- 172.21.15.81:0/1337386680 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641e45d11b0 con 0x5641e4684d40 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.178+0000 7f2835600640 10 client.5283 handle_command_reply: tid=0 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.178+0000 7f285a3ee740 1 client.5283 shutdown 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 msgr2=0x5641e4683e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ca0 tx=0x7f2848004270 comp rx=0 tx=0).stop 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 shutdown_connections 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e4684d40 0x5641e4685180 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e4699c40 0x5641e4683e00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46838c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 --2- 172.21.15.81:0/1337386680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e465a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 >> 172.21.15.81:0/1337386680 conn(0x5641e46567c0 msgr2=0x5641e4655460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f2835600640 0 client.5283 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 shutdown_connections 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 1 -- 172.21.15.81:0/1337386680 wait complete. 2024-09-11T00:55:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.179+0000 7f285a3ee740 20 client.5283 trim_cache size 0 max 16384 2024-09-11T00:55:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.197+0000 7f285a3ee740 1 Processor -- start 2024-09-11T00:55:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.197+0000 7f285a3ee740 1 -- start start 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e4699c40 0x5641e46b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28501ff510 con 0x5641e465d0c0 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28501fe3f0 con 0x5641e4699c40 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28501fcbb0 con 0x5641e469aba0 2024-09-11T00:55:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f2854a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f2854a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56078/0 (socket says 172.21.15.81:56078) 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f2854a00640 1 -- 172.21.15.81:0/3617849773 learned_addr learned my addr 172.21.15.81:0/3617849773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f2855400640 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.198+0000 7f284fe00640 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e4699c40 0x5641e46b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 -- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 msgr2=0x5641e46c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 -- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e4699c40 msgr2=0x5641e46b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e4699c40 0x5641e46b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 -- 172.21.15.81:0/3617849773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e469b990 con 0x5641e465d0c0 2024-09-11T00:55:35.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2854a00640 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f284400fca0 tx=0x7f2844012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201ada9905a01f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2837e00640 1 -- 172.21.15.81:0/3617849773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284400fd90 con 0x5641e465d0c0 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2837e00640 1 -- 172.21.15.81:0/3617849773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284402f070 con 0x5641e465d0c0 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.199+0000 7f2837e00640 1 -- 172.21.15.81:0/3617849773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844014690 con 0x5641e465d0c0 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 -- 172.21.15.81:0/3617849773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 msgr2=0x5641e46b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f284400fca0 tx=0x7f2844012000 comp rx=0 tx=0).stop 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 -- 172.21.15.81:0/3617849773 shutdown_connections 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e469aba0 0x5641e46c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e4699c40 0x5641e46b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 --2- 172.21.15.81:0/3617849773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e465d0c0 0x5641e46b0280 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 -- 172.21.15.81:0/3617849773 >> 172.21.15.81:0/3617849773 conn(0x5641e46567c0 msgr2=0x5641e465c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 -- 172.21.15.81:0/3617849773 shutdown_connections 2024-09-11T00:55:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.200+0000 7f285a3ee740 1 -- 172.21.15.81:0/3617849773 wait complete. 2024-09-11T00:55:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.201+0000 7f285a3ee740 1 -- start start 2024-09-11T00:55:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.201+0000 7f285a3ee740 1 Processor -- start 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e46a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e4699c40 0x5641e4717580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28501fd080 con 0x5641e469aba0 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28501fdd20 con 0x5641e465d0c0 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28501fd6d0 con 0x5641e4699c40 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f285a3ee740 10 client.0 _ll_register_callbacks cb 0x7f2848003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.202+0000 7f2855400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56082/0 (socket says 172.21.15.81:56082) 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 -- 172.21.15.81:0/2296163134 learned_addr learned my addr 172.21.15.81:0/2296163134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2854a00640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e46a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f284fe00640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e4699c40 0x5641e4717580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 -- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e4699c40 msgr2=0x5641e4717580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e4699c40 0x5641e4717580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 -- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 msgr2=0x5641e46a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e46a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 -- 172.21.15.81:0/2296163134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e46aa420 con 0x5641e469aba0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2855400640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ca0 tx=0x7f2848044690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fe94d963c4c61b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2835600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.203+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284802b050 con 0x5641e469aba0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f284804b2f0 con 0x5641e469aba0 2024-09-11T00:55:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f284402f070 con 0x5641e469aba0 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2848044be0 con 0x5641e469aba0 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 10 client.5289 fetch_fsmap learned FSMap version 9 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5641e469f840 con 0x5641e469aba0 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284402f070 con 0x5641e469aba0 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2848067080 con 0x5641e469aba0 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 10 client.5289 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 10 client.5289 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 20 client.5289 populate_metadata read hostname 'smithi081' 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e46a9f20 0x5641e4720e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 4 client.5289 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}] 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.204+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}) -- 0x5641e4658c80 con 0x5641e46a9f20 2024-09-11T00:55:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.205+0000 7f2854a00640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e46a9f20 0x5641e4720e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:55:35.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.205+0000 7f2854a00640 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e46a9f20 0x5641e4720e60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71c5844075c6f917 server_cookie=f1593ff96f8cf452 in_seq=0 out_seq=0 2024-09-11T00:55:35.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.205+0000 7f2835600640 10 client.5289 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:55:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.289+0000 7f2835600640 1 -- 172.21.15.81:0/2296163134 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5641e4658c80 con 0x5641e46a9f20 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.289+0000 7f2835600640 10 client.5289 handle_command_reply: tid=0 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.289+0000 7f285a3ee740 1 client.5289 shutdown 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 msgr2=0x5641e4717ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ca0 tx=0x7f2848044690 comp rx=0 tx=0).stop 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 shutdown_connections 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5641e46a9f20 0x5641e4720e60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641e469aba0 0x5641e4717ac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641e4699c40 0x5641e4717580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 --2- 172.21.15.81:0/2296163134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641e465d0c0 0x5641e46a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f2835600640 0 client.5289 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 >> 172.21.15.81:0/2296163134 conn(0x5641e46567c0 msgr2=0x5641e46b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 shutdown_connections 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 1 -- 172.21.15.81:0/2296163134 wait complete. 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.290+0000 7f285a3ee740 20 client.5289 trim_cache size 0 max 16384 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 34, 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "1bfac09c": { 2024-09-11T00:55:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 34, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.4, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:55:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:55:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:55:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:55:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:55:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:55:35.296 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 msgr2=0x7f283007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 0x7f283007a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2844001720 tx=0x7f2844009040 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 msgr2=0x7f28500c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c4c0 tx=0x7f283c00c980 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 shutdown_connections 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2830077f70 0x7f283007a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2850154810 0x7f28500ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28500cc030 0x7f28500c8350 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 --2- 172.21.15.81:0/3024914514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500c5670 0x7f28500c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 >> 172.21.15.81:0/3024914514 conn(0x7f28500688e0 msgr2=0x7f28500d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:55:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 shutdown_connections 2024-09-11T00:55:35.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:55:35.291+0000 7f2855e00640 1 -- 172.21.15.81:0/3024914514 wait complete. 2024-09-11T00:55:35.307 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1bfac09c', quiesce took 0.8 seconds. Will release after: 24.599999999999998 2024-09-11T00:55:49.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:55:49.065 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:55:59.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:56:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 -- 172.21.15.81:0/3351324987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754074860 msgr2=0x7fe7540c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 --2- 172.21.15.81:0/3351324987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754074860 0x7fe7540c7980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe75415c630 tx=0x7fe74402a5a0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 -- 172.21.15.81:0/3351324987 shutdown_connections 2024-09-11T00:56:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 --2- 172.21.15.81:0/3351324987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754074860 0x7fe7540c7980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 --2- 172.21.15.81:0/3351324987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754152610 0x7fe7540c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 -- 172.21.15.81:0/3351324987 >> 172.21.15.81:0/3351324987 conn(0x7fe7540700f0 msgr2=0x7fe754070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 -- 172.21.15.81:0/3351324987 shutdown_connections 2024-09-11T00:56:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.078+0000 7fe75c800640 1 -- 172.21.15.81:0/3351324987 wait complete. 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.080+0000 7fe75c800640 1 Processor -- start 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.080+0000 7fe75c800640 1 -- start start 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754074860 0x7fe7541f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 0x7fe75414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe754070cf0 con 0x7fe754152e00 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe75415c140 con 0x7fe754152610 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7541529f0 con 0x7fe754074860 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48090/0 (socket says 172.21.15.81:48090) 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe75a800640 1 -- 172.21.15.81:0/2155914744 learned_addr learned my addr 172.21.15.81:0/2155914744 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe759400640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 0x7fe75414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.081+0000 7fe759e00640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754074860 0x7fe7541f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 -- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754074860 msgr2=0x7fe7541f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754074860 0x7fe7541f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 -- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 msgr2=0x7fe75414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 0x7fe75414d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 -- 172.21.15.81:0/2155914744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe754155910 con 0x7fe754152e00 2024-09-11T00:56:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe759400640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 0x7fe75414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75a800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe75000cb10 tx=0x7fe75000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750016020 con 0x7fe754152e00 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe75000ad60 con 0x7fe754152e00 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750012680 con 0x7fe754152e00 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7541f6260 con 0x7fe754152e00 2024-09-11T00:56:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.082+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75415b7d0 con 0x7fe754152e00 2024-09-11T00:56:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.083+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7540c2ea0 con 0x7fe754152e00 2024-09-11T00:56:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.084+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe75001b400 con 0x7fe754152e00 2024-09-11T00:56:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.086+0000 7fe74e000640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 0x7fe73807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.086+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe75009aad0 con 0x7fe754152e00 2024-09-11T00:56:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.086+0000 7fe759e00640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 0x7fe73807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.087+0000 7fe759e00640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 0x7fe73807a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe748005fd0 tx=0x7fe748005850 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.090+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe750020020 con 0x7fe754152e00 2024-09-11T00:56:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.308+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe754151710 con 0x7fe754152e00 2024-09-11T00:56:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.308+0000 7fe74e000640 1 -- 172.21.15.81:0/2155914744 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fe7500631c0 con 0x7fe754152e00 2024-09-11T00:56:00.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:56:00.311 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:56:00.311 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.310+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 msgr2=0x7fe73807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.310+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 0x7fe73807a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe748005fd0 tx=0x7fe748005850 comp rx=0 tx=0).stop 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.310+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 msgr2=0x7fe7541595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.310+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe75000cb10 tx=0x7fe75000a060 comp rx=0 tx=0).stop 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 shutdown_connections 2024-09-11T00:56:00.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe738077f70 0x7fe73807a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754152e00 0x7fe7541595f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe754152610 0x7fe75414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 --2- 172.21.15.81:0/2155914744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe754074860 0x7fe7541f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 >> 172.21.15.81:0/2155914744 conn(0x7fe7540700f0 msgr2=0x7fe7540c17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 shutdown_connections 2024-09-11T00:56:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.311+0000 7fe75c800640 1 -- 172.21.15.81:0/2155914744 wait complete. 2024-09-11T00:56:00.328 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 1bfac09c --release --await' 2024-09-11T00:56:00.328 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 1bfac09c --release --await 2024-09-11T00:56:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 -- 172.21.15.81:0/1290550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c072cf0 msgr2=0x7f6d3c074dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 --2- 172.21.15.81:0/1290550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c072cf0 0x7f6d3c074dd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005fd0 tx=0x7f6d3402a9d0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 -- 172.21.15.81:0/1290550323 shutdown_connections 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 --2- 172.21.15.81:0/1290550323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c072cf0 0x7f6d3c074dd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 -- 172.21.15.81:0/1290550323 >> 172.21.15.81:0/1290550323 conn(0x7f6d3c0c8990 msgr2=0x7f6d3c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 -- 172.21.15.81:0/1290550323 shutdown_connections 2024-09-11T00:56:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.492+0000 7f6d41800640 1 -- 172.21.15.81:0/1290550323 wait complete. 2024-09-11T00:56:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.493+0000 7f6d41800640 1 Processor -- start 2024-09-11T00:56:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 -- start start 2024-09-11T00:56:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 0x7f6d3c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 0x7f6d3c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c0c73c0 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c158df0 con 0x7f6d3c152550 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.494+0000 7f6d41800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3c0c8280 con 0x7f6d3c072cf0 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48116/0 (socket says 172.21.15.81:48116) 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 -- 172.21.15.81:0/708845585 learned_addr learned my addr 172.21.15.81:0/708845585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d3be00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 0x7f6d3c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d3b400640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 0x7f6d3c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 -- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 msgr2=0x7f6d3c154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 0x7f6d3c154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 -- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 msgr2=0x7f6d3c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 0x7f6d3c154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 -- 172.21.15.81:0/708845585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c0c15e0 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d3be00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 0x7f6d3c154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d3b400640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 0x7f6d3c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.495+0000 7f6d40e00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009cd0 tx=0x7f6d34030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.496+0000 7f6d33e00640 1 -- 172.21.15.81:0/708845585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34047070 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.496+0000 7f6d33e00640 1 -- 172.21.15.81:0/708845585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d34003c40 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.496+0000 7f6d33e00640 1 -- 172.21.15.81:0/708845585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d340042a0 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.496+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c0c5640 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.496+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c153250 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.499+0000 7f6d33e00640 1 -- 172.21.15.81:0/708845585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6d34004440 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.500+0000 7f6d33e00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 0x7f6d1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.500+0000 7f6d33e00640 1 -- 172.21.15.81:0/708845585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6d340baec0 con 0x7f6d3c0c51b0 2024-09-11T00:56:00.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.500+0000 7f6d45e4f740 1 Processor -- start 2024-09-11T00:56:00.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.500+0000 7f6d45e4f740 1 -- start start 2024-09-11T00:56:00.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.500+0000 7f6d3be00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 0x7f6d1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb473e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d3be00640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 0x7f6d1c07a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007a50 tx=0x7f6d2c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 0x559acb460ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559acb39d370 con 0x559acb46aa20 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559acb38c7a0 con 0x559acb428d90 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x559acb3905b0 con 0x559acb425b20 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48120/0 (socket says 172.21.15.81:48120) 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d3b400640 1 -- 172.21.15.81:0/537455146 learned_addr learned my addr 172.21.15.81:0/537455146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d3be00640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb473e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.501+0000 7f6d40e00640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 0x559acb460ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 -- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 msgr2=0x559acb460ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 0x559acb460ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 -- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 msgr2=0x559acb473e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb473e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 -- 172.21.15.81:0/537455146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acb325010 con 0x559acb46aa20 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3be00640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb473e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d40e00640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 0x559acb460ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d3b400640 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001570 tx=0x7f6d28001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a300b2447985992 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d30c00640 1 -- 172.21.15.81:0/537455146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28019070 con 0x559acb46aa20 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d30c00640 1 -- 172.21.15.81:0/537455146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d280050d0 con 0x559acb46aa20 2024-09-11T00:56:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.502+0000 7f6d30c00640 1 -- 172.21.15.81:0/537455146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28005480 con 0x559acb46aa20 2024-09-11T00:56:00.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 -- 172.21.15.81:0/537455146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 msgr2=0x559acb4605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001570 tx=0x7f6d28001a30 comp rx=0 tx=0).stop 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 -- 172.21.15.81:0/537455146 shutdown_connections 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb425b20 0x559acb460ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb46aa20 0x559acb4605a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/537455146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb473e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 -- 172.21.15.81:0/537455146 >> 172.21.15.81:0/537455146 conn(0x559acb426f70 msgr2=0x559acb428450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 -- 172.21.15.81:0/537455146 shutdown_connections 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.503+0000 7f6d45e4f740 1 -- 172.21.15.81:0/537455146 wait complete. 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.504+0000 7f6d45e4f740 1 -- start start 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.504+0000 7f6d45e4f740 1 Processor -- start 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb46c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb46aa20 0x559acb4534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559acb333f70 con 0x559acb45fc80 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559acb332090 con 0x559acb428d90 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x559acb46cb80 con 0x559acb46aa20 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d45e4f740 10 client.0 _ll_register_callbacks cb 0x559acb09b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48122/0 (socket says 172.21.15.81:48122) 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 -- 172.21.15.81:0/2795679254 learned_addr learned my addr 172.21.15.81:0/2795679254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb46c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d3b400640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb46aa20 0x559acb4534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 -- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb46aa20 msgr2=0x559acb4534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb46aa20 0x559acb4534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 -- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 msgr2=0x559acb46c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb46c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d40e00640 1 -- 172.21.15.81:0/2795679254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acb0eeea0 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.505+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb46c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d40e00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6d340b90b0 tx=0x7f6d34004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2daa61fb6397bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34082af0 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6d34004b40 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d280050d0 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6d340836e0 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 10 client.5313 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x559acb167d30 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d280050d0 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f6d3407e930 con 0x559acb45fc80 2024-09-11T00:56:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 10 client.5313 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 10 client.5313 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 20 client.5313 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb452b50 0x559acb450e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 4 client.5313 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.506+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559acb39f2c0 con 0x559acb452b50 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.507+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb452b50 0x559acb450e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.507+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb452b50 0x559acb450e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b28923b0c8eaa87d server_cookie=ea231af3a4f42730 in_seq=0 out_seq=0 2024-09-11T00:56:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.507+0000 7f6d25600640 10 client.5313 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.508+0000 7f6d25600640 1 -- 172.21.15.81:0/2795679254 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559acb39f2c0 con 0x559acb452b50 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.508+0000 7f6d25600640 10 client.5313 handle_command_reply: tid=0 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.508+0000 7f6d45e4f740 1 client.5313 shutdown 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 msgr2=0x559acb450000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6d340b90b0 tx=0x7f6d34004990 comp rx=0 tx=0).stop 2024-09-11T00:56:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 shutdown_connections 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb452b50 0x559acb450e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb450000 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb46aa20 0x559acb4534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2795679254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb428d90 0x559acb46c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d25600640 0 client.5313 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 >> 172.21.15.81:0/2795679254 conn(0x559acb425b20 msgr2=0x559acb469f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 shutdown_connections 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2795679254 wait complete. 2024-09-11T00:56:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.509+0000 7f6d45e4f740 20 client.5313 trim_cache size 0 max 16384 2024-09-11T00:56:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.527+0000 7f6d45e4f740 1 Processor -- start 2024-09-11T00:56:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.527+0000 7f6d45e4f740 1 -- start start 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.527+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb428d90 0x559acb427e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb48f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1ff1b0 con 0x559acb45fc80 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1fe090 con 0x559acb46aa20 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3c1fc790 con 0x559acb428d90 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48132/0 (socket says 172.21.15.81:48132) 2024-09-11T00:56:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 -- 172.21.15.81:0/345705348 learned_addr learned my addr 172.21.15.81:0/345705348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 -- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb428d90 msgr2=0x559acb427e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb428d90 0x559acb427e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 -- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 msgr2=0x559acb48f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb48f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 -- 172.21.15.81:0/345705348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559acb30f2c0 con 0x559acb45fc80 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.528+0000 7f6d3b400640 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001eb0 tx=0x7f6d28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fad9df56006a863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d27e00640 1 -- 172.21.15.81:0/345705348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28022020 con 0x559acb45fc80 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d27e00640 1 -- 172.21.15.81:0/345705348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d28007040 con 0x559acb45fc80 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d27e00640 1 -- 172.21.15.81:0/345705348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28019040 con 0x559acb45fc80 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 -- 172.21.15.81:0/345705348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 msgr2=0x559acb48efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001eb0 tx=0x7f6d28000bc0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 -- 172.21.15.81:0/345705348 shutdown_connections 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb48f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb45fc80 0x559acb48efd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/345705348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb428d90 0x559acb427e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 -- 172.21.15.81:0/345705348 >> 172.21.15.81:0/345705348 conn(0x559acb425b20 msgr2=0x559acb44fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 -- 172.21.15.81:0/345705348 shutdown_connections 2024-09-11T00:56:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.529+0000 7f6d45e4f740 1 -- 172.21.15.81:0/345705348 wait complete. 2024-09-11T00:56:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.530+0000 7f6d45e4f740 1 -- start start 2024-09-11T00:56:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.530+0000 7f6d45e4f740 1 Processor -- start 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb45fc80 0x559acb4639d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb4eed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1fcce0 con 0x559acb428d90 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1fd9c0 con 0x559acb46aa20 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3c1fd330 con 0x559acb45fc80 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d45e4f740 10 client.0 _ll_register_callbacks cb 0x7f6d34009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d3be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d3be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48144/0 (socket says 172.21.15.81:48144) 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.531+0000 7f6d3be00640 1 -- 172.21.15.81:0/2752239906 learned_addr learned my addr 172.21.15.81:0/2752239906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 -- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb45fc80 msgr2=0x559acb4639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3b400640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb45fc80 0x559acb4639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d40e00640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb4eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb45fc80 0x559acb4639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 -- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 msgr2=0x559acb4eed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb4eed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 -- 172.21.15.81:0/2752239906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559acb451e70 con 0x559acb428d90 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d3be00640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x559acb4520a0 tx=0x7f6d2c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6f65d6ed543bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d25600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c02f060 con 0x559acb428d90 2024-09-11T00:56:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6d2c010040 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d28007040 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6d2c02a460 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d45e4f740 10 client.5319 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.532+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x559acb427360 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d28007040 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f6d2c038080 con 0x559acb428d90 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 10 client.5319 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 10 client.5319 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 20 client.5319 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb467f80 0x559acb4ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 4 client.5319 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1bfac09c", "release": true, "await": true}] 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1bfac09c", "release": true, "await": true}) -- 0x559acb39ad70 con 0x559acb467f80 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.533+0000 7f6d3b400640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb467f80 0x559acb4ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.534+0000 7f6d3b400640 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb467f80 0x559acb4ef260 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29dd96c7fe369c0e server_cookie=a6ca77a4d1c27b53 in_seq=0 out_seq=0 2024-09-11T00:56:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.534+0000 7f6d25600640 10 client.5319 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d25600640 1 -- 172.21.15.81:0/2752239906 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559acb39ad70 con 0x559acb467f80 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d25600640 10 client.5319 handle_command_reply: tid=0 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 client.5319 shutdown 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 msgr2=0x559acb4f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x559acb4520a0 tx=0x7f6d2c004620 comp rx=0 tx=0).stop 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 shutdown_connections 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559acb467f80 0x559acb4ef260 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559acb46aa20 0x559acb4eed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559acb45fc80 0x559acb4639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 --2- 172.21.15.81:0/2752239906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559acb428d90 0x559acb4f5cd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 >> 172.21.15.81:0/2752239906 conn(0x559acb425b20 msgr2=0x559acb47dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d25600640 0 client.5319 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 shutdown_connections 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.552+0000 7f6d45e4f740 1 -- 172.21.15.81:0/2752239906 wait complete. 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d45e4f740 20 client.5319 trim_cache size 0 max 16384 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:56:00.556 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 36, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "1bfac09c": { 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 36, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.4, 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:56:00.557 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 msgr2=0x7f6d1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 0x7f6d1c07a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007a50 tx=0x7f6d2c009040 comp rx=0 tx=0).stop 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 msgr2=0x7f6d3c0c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009cd0 tx=0x7f6d34030de0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 shutdown_connections 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d1c077f70 0x7f6d1c07a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3c0c51b0 0x7f6d3c0c26a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d3c152550 0x7f6d3c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 --2- 172.21.15.81:0/708845585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d3c072cf0 0x7f6d3c154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 >> 172.21.15.81:0/708845585 conn(0x7f6d3c0c8990 msgr2=0x7f6d3c1573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 shutdown_connections 2024-09-11T00:56:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.553+0000 7f6d41800640 1 -- 172.21.15.81:0/708845585 wait complete. 2024-09-11T00:56:00.572 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1bfac09c', total seconds elapsed: 26.1 2024-09-11T00:56:00.572 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.4 2024-09-11T00:56:00.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:56:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 -- 172.21.15.81:0/3725028843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 msgr2=0x7fe0cc15bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 --2- 172.21.15.81:0/3725028843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc15bd10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc06a030 tx=0x7fe0c402aac0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 -- 172.21.15.81:0/3725028843 shutdown_connections 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 --2- 172.21.15.81:0/3725028843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc15bd10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 --2- 172.21.15.81:0/3725028843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc072420 0x7fe0cc072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 --2- 172.21.15.81:0/3725028843 >> v2:172.21.15.167:3300/0 conn(0x7fe0cc14ec70 0x7fe0cc0c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 -- 172.21.15.81:0/3725028843 >> 172.21.15.81:0/3725028843 conn(0x7fe0cc0cdf20 msgr2=0x7fe0cc0ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 -- 172.21.15.81:0/3725028843 shutdown_connections 2024-09-11T00:56:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.747+0000 7fe0d2000640 1 -- 172.21.15.81:0/3725028843 wait complete. 2024-09-11T00:56:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.749+0000 7fe0d2000640 1 Processor -- start 2024-09-11T00:56:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.749+0000 7fe0d2000640 1 -- start start 2024-09-11T00:56:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0cc072420 0x7fe0cc0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc14ec70 0x7fe0cc147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0c3e90 con 0x7fe0cc15b860 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0c9220 con 0x7fe0cc072420 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0cc14f050 con 0x7fe0cc14ec70 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48160/0 (socket says 172.21.15.81:48160) 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d1600640 1 -- 172.21.15.81:0/1742832420 learned_addr learned my addr 172.21.15.81:0/1742832420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0d0c00640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0cc072420 0x7fe0cc0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.750+0000 7fe0cbe00640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc14ec70 0x7fe0cc147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 -- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc14ec70 msgr2=0x7fe0cc147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc14ec70 0x7fe0cc147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 -- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0cc072420 msgr2=0x7fe0cc0b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0cc072420 0x7fe0cc0b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 -- 172.21.15.81:0/1742832420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc1f1b10 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0d1600640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402b0b0 tx=0x7fe0c4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4003e50 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0c4004250 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.751+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4004680 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.752+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc1f15b0 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.752+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc1f1830 con 0x7fe0cc15b860 2024-09-11T00:56:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.753+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc0700d0 con 0x7fe0cc15b860 2024-09-11T00:56:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.754+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0c4049430 con 0x7fe0cc15b860 2024-09-11T00:56:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.755+0000 7fe0c8c00640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 0x7fe0ac07a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.755+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe0c40bac70 con 0x7fe0cc15b860 2024-09-11T00:56:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.755+0000 7fe0d0c00640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 0x7fe0ac07a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.756+0000 7fe0d0c00640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 0x7fe0ac07a5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009bd0 tx=0x7fe0c0005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.760+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0cc0700d0 con 0x7fe0cc15b860 2024-09-11T00:56:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.991+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0cc0b3d30 con 0x7fe0cc15b860 2024-09-11T00:56:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.992+0000 7fe0c8c00640 1 -- 172.21.15.81:0/1742832420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fe0c40ba030 con 0x7fe0cc15b860 2024-09-11T00:56:00.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:56:00.995 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:56:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:56:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 msgr2=0x7fe0ac07a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 0x7fe0ac07a5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009bd0 tx=0x7fe0c0005f90 comp rx=0 tx=0).stop 2024-09-11T00:56:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 msgr2=0x7fe0cc0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402b0b0 tx=0x7fe0c4003ce0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 shutdown_connections 2024-09-11T00:56:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe0ac078110 0x7fe0ac07a5d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0cc15b860 0x7fe0cc0c5c00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0cc14ec70 0x7fe0cc147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 --2- 172.21.15.81:0/1742832420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0cc072420 0x7fe0cc0b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 >> 172.21.15.81:0/1742832420 conn(0x7fe0cc0cdf20 msgr2=0x7fe0cc070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 shutdown_connections 2024-09-11T00:56:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:00.995+0000 7fe0d2000640 1 -- 172.21.15.81:0/1742832420 wait complete. 2024-09-11T00:56:01.014 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0' 2024-09-11T00:56:01.014 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0 2024-09-11T00:56:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 -- 172.21.15.81:0/2722364304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8710154180 msgr2=0x7f8710156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 --2- 172.21.15.81:0/2722364304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8710154180 0x7f8710156b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8710069e20 tx=0x7f870002b890 comp rx=0 tx=0).stop 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 -- 172.21.15.81:0/2722364304 shutdown_connections 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 --2- 172.21.15.81:0/2722364304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f871015acd0 0x7f87100741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 --2- 172.21.15.81:0/2722364304 >> v2:172.21.15.167:3300/0 conn(0x7f87100c0f90 0x7f8710073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 --2- 172.21.15.81:0/2722364304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8710154180 0x7f8710156b50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.197+0000 7f8715600640 1 -- 172.21.15.81:0/2722364304 >> 172.21.15.81:0/2722364304 conn(0x7f8710070030 msgr2=0x7f8710070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.198+0000 7f8715600640 1 -- 172.21.15.81:0/2722364304 shutdown_connections 2024-09-11T00:56:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.198+0000 7f8715600640 1 -- 172.21.15.81:0/2722364304 wait complete. 2024-09-11T00:56:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.199+0000 7f8715600640 1 Processor -- start 2024-09-11T00:56:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.199+0000 7f8715600640 1 -- start start 2024-09-11T00:56:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 0x7f87100c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8710154180 0x7f871014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8710157090 con 0x7f871015acd0 2024-09-11T00:56:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f871015a7b0 con 0x7f87100c0f90 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f8715600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8710154560 con 0x7f8710154180 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.200+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 0x7f87100c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48170/0 (socket says 172.21.15.81:48170) 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 -- 172.21.15.81:0/3173342758 learned_addr learned my addr 172.21.15.81:0/3173342758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870e000640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8710154180 0x7f871014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 -- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8710154180 msgr2=0x7f871014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8710154180 0x7f871014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 -- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 msgr2=0x7f87100c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 0x7f87100c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 -- 172.21.15.81:0/3173342758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87100c8250 con 0x7f871015acd0 2024-09-11T00:56:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870ea00640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 0x7f87100c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.201+0000 7f870f400640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f870800e960 tx=0x7f870800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.202+0000 7f8706a00640 1 -- 172.21.15.81:0/3173342758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708004d20 con 0x7f871015acd0 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.202+0000 7f8706a00640 1 -- 172.21.15.81:0/3173342758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870800cb20 con 0x7f871015acd0 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.202+0000 7f8706a00640 1 -- 172.21.15.81:0/3173342758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708005020 con 0x7f871015acd0 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.202+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101f1040 con 0x7f871015acd0 2024-09-11T00:56:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.202+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101f1320 con 0x7f871015acd0 2024-09-11T00:56:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.205+0000 7f8706a00640 1 -- 172.21.15.81:0/3173342758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f870800f040 con 0x7f871015acd0 2024-09-11T00:56:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.206+0000 7f8706a00640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 0x7f86f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.206+0000 7f8706a00640 1 -- 172.21.15.81:0/3173342758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f870809a5c0 con 0x7f871015acd0 2024-09-11T00:56:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.206+0000 7f8718484740 1 Processor -- start 2024-09-11T00:56:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.206+0000 7f8718484740 1 -- start start 2024-09-11T00:56:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.206+0000 7f870ea00640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 0x7f86f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f870ea00640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 0x7f86f007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8700035000 tx=0x7f8700004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74d7610 0x5588b74d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b74de650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5588b7450260 con 0x5588b751b9f0 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588b743f690 con 0x5588b74ddf10 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.207+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5588b74434a0 con 0x5588b74d7610 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74d7610 0x5588b74d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48186/0 (socket says 172.21.15.81:48186) 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 -- 172.21.15.81:0/1818880163 learned_addr learned my addr 172.21.15.81:0/1818880163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870e000640 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b74de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 -- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74d7610 msgr2=0x5588b74d79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74d7610 0x5588b74d79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 -- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 msgr2=0x5588b74de650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b74de650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 -- 172.21.15.81:0/1818880163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b7219d80 con 0x5588b751b9f0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.208+0000 7f870f400640 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f87080092f0 tx=0x7f8708061e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff37eba363c21c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.209+0000 7f86fb000640 1 -- 172.21.15.81:0/1818880163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870801f040 con 0x5588b751b9f0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.209+0000 7f86fb000640 1 -- 172.21.15.81:0/1818880163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8708067090 con 0x5588b751b9f0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.209+0000 7f86fb000640 1 -- 172.21.15.81:0/1818880163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870806bab0 con 0x5588b751b9f0 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.209+0000 7f8718484740 1 -- 172.21.15.81:0/1818880163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 msgr2=0x5588b7512b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.209+0000 7f8718484740 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f87080092f0 tx=0x7f8708061e90 comp rx=0 tx=0).stop 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 -- 172.21.15.81:0/1818880163 shutdown_connections 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b7512b60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b74de650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 --2- 172.21.15.81:0/1818880163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74d7610 0x5588b74d79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 -- 172.21.15.81:0/1818880163 >> 172.21.15.81:0/1818880163 conn(0x5588b74d9370 msgr2=0x5588b74dcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 -- 172.21.15.81:0/1818880163 shutdown_connections 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.210+0000 7f8718484740 1 -- 172.21.15.81:0/1818880163 wait complete. 2024-09-11T00:56:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.211+0000 7f8718484740 1 -- start start 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.211+0000 7f8718484740 1 Processor -- start 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b7508100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b75054d0 0x5588b7511d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5588b71afcc0 con 0x5588b751b9f0 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588b73e4e60 con 0x5588b74ddf10 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5588b74dd350 con 0x5588b75054d0 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f8718484740 10 client.0 _ll_register_callbacks cb 0x5588b73eb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f870e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f870e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48198/0 (socket says 172.21.15.81:48198) 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f870e000640 1 -- 172.21.15.81:0/2786645381 learned_addr learned my addr 172.21.15.81:0/2786645381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.212+0000 7f870ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b7508100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870f400640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b75054d0 0x5588b7511d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 -- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b75054d0 msgr2=0x5588b7511d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b75054d0 0x5588b7511d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 -- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 msgr2=0x5588b7508100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b7508100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 -- 172.21.15.81:0/2786645381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b727a510 con 0x5588b751b9f0 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870ea00640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b7508100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:56:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f870e000640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00bb00 tx=0x7f86fc004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55959e28cd30113d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f86ef400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc003e80 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f86fc005020 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.213+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8708067090 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f86fc023050 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 10 client.5337 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5588b717ec20 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8708067090 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f86fc026020 con 0x5588b751b9f0 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 10 client.5337 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 10 client.5337 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 20 client.5337 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b7506bf0 0x5588b7504de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 4 client.5337 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.214+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588b74521b0 con 0x5588b7506bf0 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.215+0000 7f870ea00640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b7506bf0 0x5588b7504de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.215+0000 7f86ef400640 10 client.5337 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.215+0000 7f870ea00640 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b7506bf0 0x5588b7504de0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8e56f74da83526 server_cookie=217f5444d6ee0ef5 in_seq=0 out_seq=0 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.216+0000 7f86ef400640 1 -- 172.21.15.81:0/2786645381 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588b74521b0 con 0x5588b7506bf0 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.216+0000 7f86ef400640 10 client.5337 handle_command_reply: tid=0 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.216+0000 7f8718484740 1 client.5337 shutdown 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 msgr2=0x5588b752e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00bb00 tx=0x7f86fc004500 comp rx=0 tx=0).stop 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 shutdown_connections 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b7506bf0 0x5588b7504de0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b75054d0 0x5588b7511d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b751b9f0 0x5588b752e430 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 --2- 172.21.15.81:0/2786645381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b74ddf10 0x5588b7508100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 >> 172.21.15.81:0/2786645381 conn(0x5588b74d7610 msgr2=0x5588b750eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f86ef400640 0 client.5337 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 shutdown_connections 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 1 -- 172.21.15.81:0/2786645381 wait complete. 2024-09-11T00:56:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.217+0000 7f8718484740 20 client.5337 trim_cache size 0 max 16384 2024-09-11T00:56:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.243+0000 7f8718484740 1 Processor -- start 2024-09-11T00:56:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.243+0000 7f8718484740 1 -- start start 2024-09-11T00:56:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 0x5588b7511c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b7541930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87101ff3e0 con 0x5588b7541e70 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87101fe2c0 con 0x5588b751b9f0 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.244+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f87101fc8e0 con 0x5588b74ddf10 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48214/0 (socket says 172.21.15.81:48214) 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 -- 172.21.15.81:0/2953502155 learned_addr learned my addr 172.21.15.81:0/2953502155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870ea00640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 0x5588b7511c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870e000640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b7541930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 -- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 msgr2=0x5588b7511c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 0x5588b7511c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 -- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 msgr2=0x5588b7541930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b7541930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 -- 172.21.15.81:0/2953502155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b74dc9f0 con 0x5588b7541e70 2024-09-11T00:56:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870e000640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b7541930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870ea00640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 0x5588b7511c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.245+0000 7f870f400640 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87080625f0 tx=0x7f8708004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2877021c187b9ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.246+0000 7f86fa600640 1 -- 172.21.15.81:0/2953502155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870801f040 con 0x5588b7541e70 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.246+0000 7f86fa600640 1 -- 172.21.15.81:0/2953502155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870806bab0 con 0x5588b7541e70 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.246+0000 7f86fa600640 1 -- 172.21.15.81:0/2953502155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870809a0b0 con 0x5588b7541e70 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- 172.21.15.81:0/2953502155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 msgr2=0x5588b74da3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87080625f0 tx=0x7f8708004fb0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- 172.21.15.81:0/2953502155 shutdown_connections 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b7541e70 0x5588b74da3b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b7541930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 --2- 172.21.15.81:0/2953502155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b74ddf10 0x5588b7511c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- 172.21.15.81:0/2953502155 >> 172.21.15.81:0/2953502155 conn(0x5588b74d7610 msgr2=0x5588b750e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- 172.21.15.81:0/2953502155 shutdown_connections 2024-09-11T00:56:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- 172.21.15.81:0/2953502155 wait complete. 2024-09-11T00:56:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.247+0000 7f8718484740 1 -- start start 2024-09-11T00:56:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 Processor -- start 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b750a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b7541e70 0x5588b750ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87101fcf30 con 0x5588b74ddf10 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87101fdbf0 con 0x5588b751b9f0 2024-09-11T00:56:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.248+0000 7f8718484740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f87101fd580 con 0x5588b7541e70 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f8718484740 10 client.0 _ll_register_callbacks cb 0x7f86fc0043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48222/0 (socket says 172.21.15.81:48222) 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 -- 172.21.15.81:0/307654343 learned_addr learned my addr 172.21.15.81:0/307654343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870e000640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b750a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870f400640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b7541e70 0x5588b750ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 -- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b7541e70 msgr2=0x5588b750ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b7541e70 0x5588b750ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 -- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 msgr2=0x5588b750a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b750a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.249+0000 7f870ea00640 1 -- 172.21.15.81:0/307654343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b750b6b0 con 0x5588b74ddf10 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f870ea00640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8700000c00 tx=0x7f870000a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3729a7ac456f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700061060 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8700037040 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870806bab0 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8700067050 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f8718484740 10 client.5343 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5588b759f140 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870806bab0 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.250+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f870006a020 con 0x5588b74ddf10 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 10 client.5343 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 10 client.5343 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 20 client.5343 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b75981a0 0x5588b7598580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 4 client.5343 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}] 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}) -- 0x5588b744dc60 con 0x5588b75981a0 2024-09-11T00:56:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.251+0000 7f870e000640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b75981a0 0x5588b7598580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.252+0000 7f86ef400640 10 client.5343 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.252+0000 7f870e000640 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b75981a0 0x5588b7598580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1537f7d1c601425 server_cookie=d88b315d52828c23 in_seq=0 out_seq=0 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f86ef400640 1 -- 172.21.15.81:0/307654343 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5588b744dc60 con 0x5588b75981a0 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f86ef400640 10 client.5343 handle_command_reply: tid=0 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 client.5343 shutdown 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 msgr2=0x5588b7512830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8700000c00 tx=0x7f870000a370 comp rx=0 tx=0).stop 2024-09-11T00:56:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 shutdown_connections 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5588b75981a0 0x5588b7598580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5588b7541e70 0x5588b750ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588b751b9f0 0x5588b750a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f86ef400640 0 client.5343 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 --2- 172.21.15.81:0/307654343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588b74ddf10 0x5588b7512830 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 >> 172.21.15.81:0/307654343 conn(0x5588b74d7610 msgr2=0x5588b7511c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 shutdown_connections 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.327+0000 7f8718484740 1 -- 172.21.15.81:0/307654343 wait complete. 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8718484740 20 client.5343 trim_cache size 0 max 16384 2024-09-11T00:56:01.331 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 38, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "f5853a35": { 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 38, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:56:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.4, 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:01.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:56:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 msgr2=0x7f86f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 0x7f86f007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8700035000 tx=0x7f8700004730 comp rx=0 tx=0).stop 2024-09-11T00:56:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 msgr2=0x7f8710149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f870800e960 tx=0x7f870800ee20 comp rx=0 tx=0).stop 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 shutdown_connections 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f86f0077f70 0x7f86f007a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871015acd0 0x7f8710149c60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8710154180 0x7f871014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 --2- 172.21.15.81:0/3173342758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100c0f90 0x7f87100c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 >> 172.21.15.81:0/3173342758 conn(0x7f8710070030 msgr2=0x7f8710153490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 shutdown_connections 2024-09-11T00:56:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:01.328+0000 7f8715600640 1 -- 172.21.15.81:0/3173342758 wait complete. 2024-09-11T00:56:01.346 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f5853a35', quiesce took 0.8 seconds. Will release after: 24.599999999999998 2024-09-11T00:56:19.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:56:19.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:56:25.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:56:26.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 -- 172.21.15.81:0/412342425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 msgr2=0x7f1b0c0c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 --2- 172.21.15.81:0/412342425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0c7980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0769a0 tx=0x7f1af802a5d0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 -- 172.21.15.81:0/412342425 shutdown_connections 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 --2- 172.21.15.81:0/412342425 >> v2:172.21.15.167:3300/0 conn(0x7f1b0c0c8680 0x7f1b0c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 --2- 172.21.15.81:0/412342425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0c7980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 -- 172.21.15.81:0/412342425 >> 172.21.15.81:0/412342425 conn(0x7f1b0c0700f0 msgr2=0x7f1b0c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 -- 172.21.15.81:0/412342425 shutdown_connections 2024-09-11T00:56:26.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.111+0000 7f1b13e00640 1 -- 172.21.15.81:0/412342425 wait complete. 2024-09-11T00:56:26.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.112+0000 7f1b13e00640 1 Processor -- start 2024-09-11T00:56:26.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 -- start start 2024-09-11T00:56:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b0c152610 0x7f1b0c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c0739d0 0x7f1b0c1f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c070cf0 con 0x7f1b0c074860 2024-09-11T00:56:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c15c140 con 0x7f1b0c0739d0 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.113+0000 7f1b13e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0c16a0 con 0x7f1b0c152610 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59764/0 (socket says 172.21.15.81:59764) 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 -- 172.21.15.81:0/1352893996 learned_addr learned my addr 172.21.15.81:0/1352893996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b10a00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b0c152610 0x7f1b0c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c0739d0 0x7f1b0c1f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 -- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b0c152610 msgr2=0x7f1b0c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b0c152610 0x7f1b0c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 -- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c0739d0 msgr2=0x7f1b0c1f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c0739d0 0x7f1b0c1f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 -- 172.21.15.81:0/1352893996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0b1130 con 0x7f1b0c074860 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.114+0000 7f1b11400640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c3d0 tx=0x7f1b0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.115+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00006890 con 0x7f1b0c074860 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.115+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b00006b20 con 0x7f1b0c074860 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.115+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c073780 con 0x7f1b0c074860 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.115+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00007020 con 0x7f1b0c074860 2024-09-11T00:56:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.115+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c0745d0 con 0x7f1b0c074860 2024-09-11T00:56:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.116+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c1529f0 con 0x7f1b0c074860 2024-09-11T00:56:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.117+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1b000071c0 con 0x7f1b0c074860 2024-09-11T00:56:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.118+0000 7f1b09600640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 0x7f1aec07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.118+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1b00099b70 con 0x7f1b0c074860 2024-09-11T00:56:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.118+0000 7f1b10a00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 0x7f1aec07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.119+0000 7f1b10a00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 0x7f1aec07a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1af8034000 tx=0x7f1af8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.122+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1b0c0b1130 con 0x7f1b0c074860 2024-09-11T00:56:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.338+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b0c0c2a70 con 0x7f1b0c074860 2024-09-11T00:56:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.338+0000 7f1b09600640 1 -- 172.21.15.81:0/1352893996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f1b00062270 con 0x7f1b0c074860 2024-09-11T00:56:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:56:26.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:56:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.340+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 msgr2=0x7f1aec07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.340+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 0x7f1aec07a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1af8034000 tx=0x7f1af8004730 comp rx=0 tx=0).stop 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.340+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 msgr2=0x7f1b0c0ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.340+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c3d0 tx=0x7f1b0000c890 comp rx=0 tx=0).stop 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 shutdown_connections 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1aec077fa0 0x7f1aec07a460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c0739d0 0x7f1b0c1f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b0c152610 0x7f1b0c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 --2- 172.21.15.81:0/1352893996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c074860 0x7f1b0c0ae8c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 >> 172.21.15.81:0/1352893996 conn(0x7f1b0c0700f0 msgr2=0x7f1b0c150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 shutdown_connections 2024-09-11T00:56:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.341+0000 7f1b13e00640 1 -- 172.21.15.81:0/1352893996 wait complete. 2024-09-11T00:56:26.358 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id f5853a35 --release --await' 2024-09-11T00:56:26.358 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id f5853a35 --release --await 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 -- 172.21.15.81:0/1671613608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840c9ca0 msgr2=0x7f7e8406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 --2- 172.21.15.81:0/1671613608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840c9ca0 0x7f7e8406d590 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7e8408d9a0 tx=0x7f7e7802aac0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 -- 172.21.15.81:0/1671613608 shutdown_connections 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 --2- 172.21.15.81:0/1671613608 >> v2:172.21.15.167:3300/0 conn(0x7f7e840ccff0 0x7f7e840cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 --2- 172.21.15.81:0/1671613608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840c9ca0 0x7f7e8406d590 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 -- 172.21.15.81:0/1671613608 >> 172.21.15.81:0/1671613608 conn(0x7f7e84068d00 msgr2=0x7f7e84069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 -- 172.21.15.81:0/1671613608 shutdown_connections 2024-09-11T00:56:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.522+0000 7f7e8b000640 1 -- 172.21.15.81:0/1671613608 wait complete. 2024-09-11T00:56:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.524+0000 7f7e8b000640 1 Processor -- start 2024-09-11T00:56:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.524+0000 7f7e8b000640 1 -- start start 2024-09-11T00:56:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 0x7f7e841f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 0x7f7e841509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406d070 con 0x7f7e840ccff0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406cd90 con 0x7f7e840c9ca0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e840cc6a0 con 0x7f7e8415daf0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59786/0 (socket says 172.21.15.81:59786) 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 -- 172.21.15.81:0/3494119964 learned_addr learned my addr 172.21.15.81:0/3494119964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 0x7f7e841f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 -- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 msgr2=0x7f7e841509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8a600640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 0x7f7e841509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 0x7f7e841509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 -- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 msgr2=0x7f7e841f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 0x7f7e841f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89200640 1 -- 172.21.15.81:0/3494119964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e84150350 con 0x7f7e840ccff0 2024-09-11T00:56:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 0x7f7e841f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.525+0000 7f7e8a600640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 0x7f7e841509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e89200640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000b420 tx=0x7f7e7000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e81600640 1 -- 172.21.15.81:0/3494119964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011830 con 0x7f7e840ccff0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e81600640 1 -- 172.21.15.81:0/3494119964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e70016070 con 0x7f7e840ccff0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e81600640 1 -- 172.21.15.81:0/3494119964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011d60 con 0x7f7e840ccff0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8414e680 con 0x7f7e840ccff0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.526+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8414ec20 con 0x7f7e840ccff0 2024-09-11T00:56:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.528+0000 7f7e81600640 1 -- 172.21.15.81:0/3494119964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7e7001b460 con 0x7f7e840ccff0 2024-09-11T00:56:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.529+0000 7f7e81600640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 0x7f7e6407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.529+0000 7f7e81600640 1 -- 172.21.15.81:0/3494119964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7e70099cc0 con 0x7f7e840ccff0 2024-09-11T00:56:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e8f5fa740 1 Processor -- start 2024-09-11T00:56:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e8f5fa740 1 -- start start 2024-09-11T00:56:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 0x7f7e6407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 0x7f7e6407a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e78035000 tx=0x7f7e78004ab0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.530+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8fda20 0x561f6a8f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8b8b20 0x561f6a8f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f6a830370 con 0x561f6a8bbd90 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561f6a81f7a0 con 0x561f6a8b8b20 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x561f6a8235b0 con 0x561f6a8fda20 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59796/0 (socket says 172.21.15.81:59796) 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 -- 172.21.15.81:0/587750349 learned_addr learned my addr 172.21.15.81:0/587750349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89200640 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8fda20 0x561f6a8f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e8a600640 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8b8b20 0x561f6a8f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 -- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8fda20 msgr2=0x561f6a8f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8fda20 0x561f6a8f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 -- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8b8b20 msgr2=0x561f6a8f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8b8b20 0x561f6a8f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.531+0000 7f7e89c00640 1 -- 172.21.15.81:0/587750349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6a7b8010 con 0x561f6a8bbd90 2024-09-11T00:56:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e89c00640 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7e78005fd0 tx=0x7f7e7803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba329751b649ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e76000640 1 -- 172.21.15.81:0/587750349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7802c620 con 0x561f6a8bbd90 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e76000640 1 -- 172.21.15.81:0/587750349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7802c7c0 con 0x561f6a8bbd90 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e76000640 1 -- 172.21.15.81:0/587750349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7802cbb0 con 0x561f6a8bbd90 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/587750349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 msgr2=0x561f6a906e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.532+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7e78005fd0 tx=0x7f7e7803d000 comp rx=0 tx=0).stop 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/587750349 shutdown_connections 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8b8b20 0x561f6a8f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8fda20 0x561f6a8f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/587750349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a906e30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/587750349 >> 172.21.15.81:0/587750349 conn(0x561f6a8b9f70 msgr2=0x561f6a8bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/587750349 shutdown_connections 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/587750349 wait complete. 2024-09-11T00:56:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 -- start start 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.533+0000 7f7e8f5fa740 1 Processor -- start 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8fda20 0x561f6a8fc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f6a7c6f70 con 0x561f6a8bbd90 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561f6a7c5090 con 0x561f6a8fda20 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.534+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x561f6a8f1a70 con 0x561f6a8f1370 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e8f5fa740 10 client.0 _ll_register_callbacks cb 0x561f6a52e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59800/0 (socket says 172.21.15.81:59800) 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 -- 172.21.15.81:0/3252857223 learned_addr learned my addr 172.21.15.81:0/3252857223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89200640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8fda20 0x561f6a8fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e8a600640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 -- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 msgr2=0x561f6a8f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 -- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8fda20 msgr2=0x561f6a8fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8fda20 0x561f6a8fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 -- 172.21.15.81:0/3252857223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6a581ea0 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e89c00640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e7803f040 tx=0x7f7e78003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e43a3665c36586 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.535+0000 7f7e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7802c970 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7e7802cb10 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7802c7c0 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7e78060050 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 10 client.5364 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561f6a5fad30 con 0x561f6a8bbd90 2024-09-11T00:56:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7802c7c0 con 0x561f6a8bbd90 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7e78063020 con 0x561f6a8bbd90 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 10 client.5364 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 10 client.5364 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 20 client.5364 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a9119e0 0x561f6a911dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 4 client.5364 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:56:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.536+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f6a8322c0 con 0x561f6a9119e0 2024-09-11T00:56:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.537+0000 7f7e89200640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a9119e0 0x561f6a911dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.537+0000 7f7e89200640 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a9119e0 0x561f6a911dc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8da4dd3250c79 server_cookie=f433aaed076a7c22 in_seq=0 out_seq=0 2024-09-11T00:56:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.537+0000 7f7e6aa00640 10 client.5364 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e6aa00640 1 -- 172.21.15.81:0/3252857223 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f6a8322c0 con 0x561f6a9119e0 2024-09-11T00:56:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e6aa00640 10 client.5364 handle_command_reply: tid=0 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 client.5364 shutdown 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 msgr2=0x561f6a9027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7e7803f040 tx=0x7f7e78003ec0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 shutdown_connections 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a9119e0 0x561f6a911dc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8fda20 0x561f6a8fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/3252857223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8bbd90 0x561f6a9027e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e6aa00640 0 client.5364 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.538+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 >> 172.21.15.81:0/3252857223 conn(0x561f6a8b8b20 msgr2=0x561f6a8b77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.539+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 shutdown_connections 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.539+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/3252857223 wait complete. 2024-09-11T00:56:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.539+0000 7f7e8f5fa740 20 client.5364 trim_cache size 0 max 16384 2024-09-11T00:56:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.556+0000 7f7e8f5fa740 1 Processor -- start 2024-09-11T00:56:26.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 -- start start 2024-09-11T00:56:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8bbd90 0x561f6a8bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 0x561f6a8f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841ff1e0 con 0x561f6a8fda20 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841fe0c0 con 0x561f6a8f1370 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.557+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e841fc8b0 con 0x561f6a8bbd90 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59814/0 (socket says 172.21.15.81:59814) 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 -- 172.21.15.81:0/1106856596 learned_addr learned my addr 172.21.15.81:0/1106856596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 -- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8bbd90 msgr2=0x561f6a8bdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8bbd90 0x561f6a8bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 -- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 msgr2=0x561f6a8f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e89200640 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 0x561f6a8f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 0x561f6a8f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 -- 172.21.15.81:0/1106856596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6a90f740 con 0x561f6a8fda20 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e89200640 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 0x561f6a8f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e8a600640 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009bd0 tx=0x7f7e7c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca264354039eee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e75600640 1 -- 172.21.15.81:0/1106856596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c020070 con 0x561f6a8fda20 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e75600640 1 -- 172.21.15.81:0/1106856596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c011450 con 0x561f6a8fda20 2024-09-11T00:56:26.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.558+0000 7f7e75600640 1 -- 172.21.15.81:0/1106856596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0118a0 con 0x561f6a8fda20 2024-09-11T00:56:26.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/1106856596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 msgr2=0x561f6a8f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009bd0 tx=0x7f7e7c013830 comp rx=0 tx=0).stop 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/1106856596 shutdown_connections 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f3eb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8f1370 0x561f6a8f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/1106856596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8bbd90 0x561f6a8bdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/1106856596 >> 172.21.15.81:0/1106856596 conn(0x561f6a8b8b20 msgr2=0x561f6a8bab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/1106856596 shutdown_connections 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.559+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/1106856596 wait complete. 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.560+0000 7f7e8f5fa740 1 -- start start 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.560+0000 7f7e8f5fa740 1 Processor -- start 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8bbd90 0x561f6a979780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841fcd50 con 0x561f6a8fda20 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841fd9f0 con 0x561f6a8bbd90 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e841fd3a0 con 0x561f6a8f1370 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8f5fa740 10 client.0 _ll_register_callbacks cb 0x7f7e7c0092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59828/0 (socket says 172.21.15.81:59828) 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8a600640 1 -- 172.21.15.81:0/94123841 learned_addr learned my addr 172.21.15.81:0/94123841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e89c00640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8bbd90 0x561f6a979780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e89200640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8a600640 1 -- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 msgr2=0x561f6a8f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.561+0000 7f7e8a600640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8a600640 1 -- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8bbd90 msgr2=0x561f6a979780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:56:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8a600640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8bbd90 0x561f6a979780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8a600640 1 -- 172.21.15.81:0/94123841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6a8f44d0 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8a600640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00a010 tx=0x7f7e7c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c3a362652bdfa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c02b070 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7e7c011a10 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7c011450 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7e7c036050 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8f5fa740 10 client.5370 fetch_fsmap learned FSMap version 9 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.562+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561f6a8fc7b0 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c011450 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7e7c039020 con 0x561f6a8fda20 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 10 client.5370 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:56:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 10 client.5370 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 20 client.5370 populate_metadata read hostname 'smithi081' 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a983680 0x561f6a97f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 4 client.5370 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f5853a35", "release": true, "await": true}] 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f5853a35", "release": true, "await": true}) -- 0x561f6a82dd70 con 0x561f6a983680 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.563+0000 7f7e89c00640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a983680 0x561f6a97f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.564+0000 7f7e6aa00640 10 client.5370 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:26.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.564+0000 7f7e89c00640 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a983680 0x561f6a97f6a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c59e960946c32e7 server_cookie=128581672bcf716c in_seq=0 out_seq=0 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e6aa00640 1 -- 172.21.15.81:0/94123841 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561f6a82dd70 con 0x561f6a983680 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e6aa00640 10 client.5370 handle_command_reply: tid=0 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 client.5370 shutdown 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 msgr2=0x561f6a8f8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00a010 tx=0x7f7e7c009820 comp rx=0 tx=0).stop 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 shutdown_connections 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x561f6a983680 0x561f6a97f6a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6a8fda20 0x561f6a8f8930 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561f6a8f1370 0x561f6a8f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 --2- 172.21.15.81:0/94123841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f6a8bbd90 0x561f6a979780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e6aa00640 0 client.5370 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 >> 172.21.15.81:0/94123841 conn(0x561f6a8b8b20 msgr2=0x561f6a8fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 shutdown_connections 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 1 -- 172.21.15.81:0/94123841 wait complete. 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.582+0000 7f7e8f5fa740 20 client.5370 trim_cache size 0 max 16384 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 40, 2024-09-11T00:56:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "f5853a35": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 40, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 145.4, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:56:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:56:26.587 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 msgr2=0x7f7e6407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 0x7f7e6407a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e78035000 tx=0x7f7e78004ab0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 msgr2=0x7f7e8414fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000b420 tx=0x7f7e7000b8e0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 shutdown_connections 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7e64077f70 0x7f7e6407a430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e8415daf0 0x7f7e841509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e840ccff0 0x7f7e8414fe10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 --2- 172.21.15.81:0/3494119964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e840c9ca0 0x7f7e841f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:56:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 >> 172.21.15.81:0/3494119964 conn(0x7f7e84068d00 msgr2=0x7f7e8415d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:56:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 shutdown_connections 2024-09-11T00:56:26.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:56:26.583+0000 7f7e8b000640 1 -- 172.21.15.81:0/3494119964 wait complete. 2024-09-11T00:56:26.601 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f5853a35', total seconds elapsed: 26.0 2024-09-11T00:56:49.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:56:49.269 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:19.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:19.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:49.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:57:49.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:00.944 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:58:00.945 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-11T00:58:00.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:58:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 -- 172.21.15.81:0/3447554845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 msgr2=0x7f58080c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 --2- 172.21.15.81:0/3447554845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f58080c8330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5800005fd0 tx=0x7f580002ab20 comp rx=0 tx=0).stop 2024-09-11T00:58:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 -- 172.21.15.81:0/3447554845 shutdown_connections 2024-09-11T00:58:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 --2- 172.21.15.81:0/3447554845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f58080c8330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 --2- 172.21.15.81:0/3447554845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6bc0 0x7f580815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 -- 172.21.15.81:0/3447554845 >> 172.21.15.81:0/3447554845 conn(0x7f580806ffd0 msgr2=0x7f58080703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 -- 172.21.15.81:0/3447554845 shutdown_connections 2024-09-11T00:58:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.130+0000 7f5807e00640 1 -- 172.21.15.81:0/3447554845 wait complete. 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.131+0000 7f5807e00640 1 Processor -- start 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 -- start start 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58080c6bc0 0x7f58080ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 0x7f58080cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58080c7e10 con 0x7f58080c0eb0 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f580815e850 con 0x7f58080c6bc0 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.132+0000 7f5807e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f580815d9e0 con 0x7f58080c6fa0 2024-09-11T00:58:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39594/0 (socket says 172.21.15.81:39594) 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 -- 172.21.15.81:0/4000328956 learned_addr learned my addr 172.21.15.81:0/4000328956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806000640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58080c6bc0 0x7f58080ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5807400640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 0x7f58080cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 -- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 msgr2=0x7f58080cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 0x7f58080cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 -- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58080c6bc0 msgr2=0x7f58080ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58080c6bc0 0x7f58080ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 -- 172.21.15.81:0/4000328956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580814ee00 con 0x7f58080c0eb0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5807400640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 0x7f58080cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.133+0000 7f5806a00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.134+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800cd80 con 0x7f58080c0eb0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.134+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57f8010430 con 0x7f58080c0eb0 2024-09-11T00:58:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.134+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8010840 con 0x7f58080c0eb0 2024-09-11T00:58:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.134+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5808074650 con 0x7f58080c0eb0 2024-09-11T00:58:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.134+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58081f44c0 con 0x7f58080c0eb0 2024-09-11T00:58:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.135+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580815aeb0 con 0x7f58080c0eb0 2024-09-11T00:58:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.136+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f57f80109e0 con 0x7f58080c0eb0 2024-09-11T00:58:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.137+0000 7f57fea00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 0x7f57e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.137+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f57f809ac90 con 0x7f58080c0eb0 2024-09-11T00:58:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.138+0000 7f5806000640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 0x7f57e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.139+0000 7f5806000640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 0x7f57e807a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58080c93e0 tx=0x7f57f4009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.142+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f580814ee00 con 0x7f58080c0eb0 2024-09-11T00:58:01.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.406+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5808075160 con 0x7f58080c0eb0 2024-09-11T00:58:01.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.406+0000 7f57fea00640 1 -- 172.21.15.81:0/4000328956 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f57f8063570 con 0x7f58080c0eb0 2024-09-11T00:58:01.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:58:01.409 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:58:01.410 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:58:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 msgr2=0x7f57e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 0x7f57e807a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58080c93e0 tx=0x7f57f4009040 comp rx=0 tx=0).stop 2024-09-11T00:58:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 msgr2=0x7f580814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 shutdown_connections 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f57e8077f70 0x7f57e807a430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58080c6fa0 0x7f58080cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58080c6bc0 0x7f58080ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 --2- 172.21.15.81:0/4000328956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58080c0eb0 0x7f580814e8c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 >> 172.21.15.81:0/4000328956 conn(0x7f580806ffd0 msgr2=0x7f5808158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 shutdown_connections 2024-09-11T00:58:01.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.409+0000 7f5807e00640 1 -- 172.21.15.81:0/4000328956 wait complete. 2024-09-11T00:58:01.429 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-11T00:58:01.429 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 -- 172.21.15.81:0/603342305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc0cc030 msgr2=0x7feefc0c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 --2- 172.21.15.81:0/603342305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc0cc030 0x7feefc0c4f60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feefc15b5a0 tx=0x7feee802a610 comp rx=0 tx=0).stop 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 -- 172.21.15.81:0/603342305 shutdown_connections 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 --2- 172.21.15.81:0/603342305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc0cc030 0x7feefc0c4f60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 -- 172.21.15.81:0/603342305 >> 172.21.15.81:0/603342305 conn(0x7feefc0688e0 msgr2=0x7feefc068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 -- 172.21.15.81:0/603342305 shutdown_connections 2024-09-11T00:58:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.607+0000 7fef02600640 1 -- 172.21.15.81:0/603342305 wait complete. 2024-09-11T00:58:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.609+0000 7fef02600640 1 Processor -- start 2024-09-11T00:58:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.609+0000 7fef02600640 1 -- start start 2024-09-11T00:58:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0c54a0 0x7feefc14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc154810 0x7feefc157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feefc15b0b0 con 0x7feefc0cc030 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0c5930 con 0x7feefc0c54a0 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef02600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feefc15a500 con 0x7feefc154810 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7feefbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7feefbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39606/0 (socket says 172.21.15.81:39606) 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7feefbe00640 1 -- 172.21.15.81:0/4263597715 learned_addr learned my addr 172.21.15.81:0/4263597715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.610+0000 7fef01200640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0c54a0 0x7feefc14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7fef01c00640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc154810 0x7feefc157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 -- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc154810 msgr2=0x7feefc157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc154810 0x7feefc157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 -- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0c54a0 msgr2=0x7feefc14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0c54a0 0x7feefc14b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 -- 172.21.15.81:0/4263597715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc0b5eb0 con 0x7feefc0cc030 2024-09-11T00:58:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feefbe00640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feee8009910 tx=0x7feee80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.611+0000 7feef8c00640 1 -- 172.21.15.81:0/4263597715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8004250 con 0x7feefc0cc030 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.612+0000 7feef8c00640 1 -- 172.21.15.81:0/4263597715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feee8032e50 con 0x7feefc0cc030 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.612+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc0b6120 con 0x7feefc0cc030 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.612+0000 7feef8c00640 1 -- 172.21.15.81:0/4263597715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee80044e0 con 0x7feefc0cc030 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.612+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc156010 con 0x7feefc0cc030 2024-09-11T00:58:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.614+0000 7feef8c00640 1 -- 172.21.15.81:0/4263597715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feee8004a00 con 0x7feefc0cc030 2024-09-11T00:58:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.615+0000 7feef8c00640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 0x7feedc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.615+0000 7feef8c00640 1 -- 172.21.15.81:0/4263597715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7feee80bb550 con 0x7feefc0cc030 2024-09-11T00:58:01.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.616+0000 7fef01200640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 0x7feedc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.616+0000 7fef06c63740 1 Processor -- start 2024-09-11T00:58:01.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.616+0000 7fef06c63740 1 -- start start 2024-09-11T00:58:01.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.616+0000 7fef01200640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 0x7feedc07a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feef0001120 tx=0x7feef0009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x557973527bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973523a10 0x557973528100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55797349b240 con 0x5579735261b0 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55797348a670 con 0x557973526b50 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55797348e480 con 0x557973523a10 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39622/0 (socket says 172.21.15.81:39622) 2024-09-11T00:58:01.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef01200640 1 -- 172.21.15.81:0/399690256 learned_addr learned my addr 172.21.15.81:0/399690256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7fef01c00640 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973523a10 0x557973528100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.617+0000 7feefbe00640 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x557973527bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 -- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973523a10 msgr2=0x557973528100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973523a10 0x557973528100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 -- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 msgr2=0x557973527bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x557973527bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 -- 172.21.15.81:0/399690256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557973264de0 con 0x5579735261b0 2024-09-11T00:58:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7fef01200640 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feef000f940 tx=0x7feef0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ccad3a67d22fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7feeed600640 1 -- 172.21.15.81:0/399690256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0025070 con 0x5579735261b0 2024-09-11T00:58:01.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7feeed600640 1 -- 172.21.15.81:0/399690256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feef001b050 con 0x5579735261b0 2024-09-11T00:58:01.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.618+0000 7feeed600640 1 -- 172.21.15.81:0/399690256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0014e40 con 0x5579735261b0 2024-09-11T00:58:01.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 -- 172.21.15.81:0/399690256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 msgr2=0x5579735234d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feef000f940 tx=0x7feef0012000 comp rx=0 tx=0).stop 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 -- 172.21.15.81:0/399690256 shutdown_connections 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973523a10 0x557973528100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x557973527bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 --2- 172.21.15.81:0/399690256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735234d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 -- 172.21.15.81:0/399690256 >> 172.21.15.81:0/399690256 conn(0x557973524350 msgr2=0x557973525830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 -- 172.21.15.81:0/399690256 shutdown_connections 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.619+0000 7fef06c63740 1 -- 172.21.15.81:0/399690256 wait complete. 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.620+0000 7fef06c63740 1 -- start start 2024-09-11T00:58:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.620+0000 7fef06c63740 1 Processor -- start 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973568130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973551cb0 0x5579735575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5579731fad20 con 0x5579735261b0 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55797342fdd0 con 0x557973551cb0 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557973522e10 con 0x557973526b50 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef06c63740 10 client.0 _ll_register_callbacks cb 0x5579731981c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39630/0 (socket says 172.21.15.81:39630) 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.621+0000 7fef01200640 1 -- 172.21.15.81:0/4000004871 learned_addr learned my addr 172.21.15.81:0/4000004871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973568130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7fef01c00640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973551cb0 0x5579735575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 -- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973551cb0 msgr2=0x5579735575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973551cb0 0x5579735575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 -- 172.21.15.81:0/4000004871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 msgr2=0x55797357c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 -- 172.21.15.81:0/4000004871 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5579732c5570 con 0x557973526b50 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7fef01200640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feefbe00640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973568130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feee8083610 tx=0x7feee8083510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82673142800b9607 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feee2000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee80a9070 con 0x557973526b50 2024-09-11T00:58:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.622+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7feee80a9210 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579734a3700 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feee8083190 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 10 client.5096 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5579731c9c80 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5579734a3700 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7feee809d080 con 0x557973526b50 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 10 client.5096 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 10 client.5096 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 20 client.5096 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557973550230 0x557973550690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 4 client.5096 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.623+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55797349d190 con 0x557973550230 2024-09-11T00:58:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.624+0000 7fef01200640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557973550230 0x557973550690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.624+0000 7fef01200640 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557973550230 0x557973550690 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace6160f37cecbe0 server_cookie=45176fa876eacdad in_seq=0 out_seq=0 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.624+0000 7feee2000640 10 client.5096 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.625+0000 7feee2000640 1 -- 172.21.15.81:0/4000004871 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55797349d190 con 0x557973550230 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.625+0000 7feee2000640 10 client.5096 handle_command_reply: tid=0 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.625+0000 7fef06c63740 1 client.5096 shutdown 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.625+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 msgr2=0x557973568130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.625+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973568130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feee8083610 tx=0x7feee8083510 comp rx=0 tx=0).stop 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 shutdown_connections 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557973550230 0x557973550690 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973551cb0 0x5579735575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973568130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 --2- 172.21.15.81:0/4000004871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x55797357c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7feee2000640 0 client.5096 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 >> 172.21.15.81:0/4000004871 conn(0x557973523a10 msgr2=0x55797355e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 shutdown_connections 2024-09-11T00:58:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 1 -- 172.21.15.81:0/4000004871 wait complete. 2024-09-11T00:58:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.626+0000 7fef06c63740 20 client.5096 trim_cache size 0 max 16384 2024-09-11T00:58:01.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.649+0000 7fef06c63740 1 Processor -- start 2024-09-11T00:58:01.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.649+0000 7fef06c63740 1 -- start start 2024-09-11T00:58:01.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579735261b0 0x557973525330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973525870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1ff2d0 con 0x557973551cb0 2024-09-11T00:58:01.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1fe1b0 con 0x5579735261b0 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feefc1f4960 con 0x557973526b50 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7fef01c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.650+0000 7feefbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973525870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39640/0 (socket says 172.21.15.81:39640) 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579735261b0 0x557973525330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 -- 172.21.15.81:0/2719559238 learned_addr learned my addr 172.21.15.81:0/2719559238 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 -- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 msgr2=0x557973525870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973525870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 -- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579735261b0 msgr2=0x557973525330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579735261b0 0x557973525330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 -- 172.21.15.81:0/2719559238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557973557940 con 0x557973551cb0 2024-09-11T00:58:01.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7fef01c00640 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feef4015710 tx=0x7feef4015b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b6630cc36a706 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7feeecc00640 1 -- 172.21.15.81:0/2719559238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4013830 con 0x557973551cb0 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7feeecc00640 1 -- 172.21.15.81:0/2719559238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feef401a070 con 0x557973551cb0 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.651+0000 7feeecc00640 1 -- 172.21.15.81:0/2719559238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4013d40 con 0x557973551cb0 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 -- 172.21.15.81:0/2719559238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 msgr2=0x55797358c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feef4015710 tx=0x7feef4015b10 comp rx=0 tx=0).stop 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 -- 172.21.15.81:0/2719559238 shutdown_connections 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557973551cb0 0x55797358c6e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973526b50 0x557973525870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 --2- 172.21.15.81:0/2719559238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579735261b0 0x557973525330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 -- 172.21.15.81:0/2719559238 >> 172.21.15.81:0/2719559238 conn(0x557973523a10 msgr2=0x5579735232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 -- 172.21.15.81:0/2719559238 shutdown_connections 2024-09-11T00:58:01.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.652+0000 7fef06c63740 1 -- 172.21.15.81:0/2719559238 wait complete. 2024-09-11T00:58:01.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.653+0000 7fef06c63740 1 -- start start 2024-09-11T00:58:01.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.653+0000 7fef06c63740 1 Processor -- start 2024-09-11T00:58:01.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x5579735683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973551cb0 0x5579735e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1fce30 con 0x5579735261b0 2024-09-11T00:58:01.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1fdae0 con 0x557973526b50 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feefc1fd450 con 0x557973551cb0 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef06c63740 10 client.0 _ll_register_callbacks cb 0x7feee807f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39656/0 (socket says 172.21.15.81:39656) 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7fef01200640 1 -- 172.21.15.81:0/504761234 learned_addr learned my addr 172.21.15.81:0/504761234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.654+0000 7feefbe00640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x5579735683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01c00640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973551cb0 0x5579735e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 -- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973551cb0 msgr2=0x5579735e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973551cb0 0x5579735e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 -- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 msgr2=0x5579735683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:01.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x5579735683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 -- 172.21.15.81:0/504761234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579735272a0 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7feefbe00640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x5579735683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef01200640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feef0023040 tx=0x7feef0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df4aae4fc2d47a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7feee2000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef003a060 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7feef0020bb0 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.655+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feef401a070 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feef0040050 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 10 client.5394 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5579735ed9d0 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feef401a070 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7feef0043020 con 0x5579735261b0 2024-09-11T00:58:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 10 client.5394 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 10 client.5394 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 20 client.5394 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5579735e72a0 0x557973566950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 4 client.5394 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.656+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x557973498c40 con 0x5579735e72a0 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.657+0000 7feefbe00640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5579735e72a0 0x557973566950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.657+0000 7feefbe00640 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5579735e72a0 0x557973566950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c68d5798b8b1b7bc server_cookie=86fa6e10aab89844 in_seq=0 out_seq=0 2024-09-11T00:58:01.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.657+0000 7feee2000640 10 client.5394 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7feee2000640 1 -- 172.21.15.81:0/504761234 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557973498c40 con 0x5579735e72a0 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7feee2000640 10 client.5394 handle_command_reply: tid=0 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 client.5394 shutdown 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 msgr2=0x5579735ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feef0023040 tx=0x7feef0000fe0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 shutdown_connections 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5579735e72a0 0x557973566950 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557973551cb0 0x5579735e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557973526b50 0x5579735683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7feee2000640 0 client.5394 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 --2- 172.21.15.81:0/504761234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579735261b0 0x5579735ed270 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 >> 172.21.15.81:0/504761234 conn(0x557973523a10 msgr2=0x557973525330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 shutdown_connections 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.734+0000 7fef06c63740 1 -- 172.21.15.81:0/504761234 wait complete. 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef06c63740 20 client.5394 trim_cache size 0 max 16384 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 42, 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "528ec57a": { 2024-09-11T00:58:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 42, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 142.8, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:01.742 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 msgr2=0x7feedc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 0x7feedc07a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feef0001120 tx=0x7feef0009040 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 msgr2=0x7feefc156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feee8009910 tx=0x7feee80052f0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 shutdown_connections 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7feedc077f70 0x7feedc07a430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feefc154810 0x7feefc157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feefc0cc030 0x7feefc156f30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 --2- 172.21.15.81:0/4263597715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feefc0c54a0 0x7feefc14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 >> 172.21.15.81:0/4263597715 conn(0x7feefc0688e0 msgr2=0x7feefc0d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.735+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 shutdown_connections 2024-09-11T00:58:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:01.736+0000 7fef02600640 1 -- 172.21.15.81:0/4263597715 wait complete. 2024-09-11T00:58:01.752 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '528ec57a', quiesce took 0.8 seconds. Will release after: 21.95 2024-09-11T00:58:19.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:19.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:23.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:58:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 -- 172.21.15.81:0/113366594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 msgr2=0x7f8320003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 --2- 172.21.15.81:0/113366594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f8320003e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f832c00bb20 tx=0x7f8320005830 comp rx=0 tx=0).stop 2024-09-11T00:58:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341400640 1 -- 172.21.15.81:0/113366594 reap_dead start 2024-09-11T00:58:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 -- 172.21.15.81:0/113366594 shutdown_connections 2024-09-11T00:58:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 -- 172.21.15.81:0/113366594 >> 172.21.15.81:0/113366594 conn(0x7f833c06ffd0 msgr2=0x7f833c0703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 -- 172.21.15.81:0/113366594 shutdown_connections 2024-09-11T00:58:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.870+0000 7f8341e00640 1 -- 172.21.15.81:0/113366594 wait complete. 2024-09-11T00:58:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.872+0000 7f8341e00640 1 Processor -- start 2024-09-11T00:58:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.872+0000 7f8341e00640 1 -- start start 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f833c1f1250 0x7f833c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 0x7f833c0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f833c0c7e10 con 0x7f8320003a70 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f833c15e850 con 0x7f833c157b50 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f833c15d9e0 con 0x7f833c1f1250 2024-09-11T00:58:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8340a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8340a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58708/0 (socket says 172.21.15.81:58708) 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8340a00640 1 -- 172.21.15.81:0/16099505 learned_addr learned my addr 172.21.15.81:0/16099505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f8341400640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 0x7f833c0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.873+0000 7f833be00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f833c1f1250 0x7f833c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 -- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f833c1f1250 msgr2=0x7f833c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f833c1f1250 0x7f833c15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 -- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 msgr2=0x7f833c0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 0x7f833c0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 -- 172.21.15.81:0/16099505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c156360 con 0x7f8320003a70 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8341400640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 0x7f833c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8340a00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f832c00bc40 tx=0x7f832c031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c035040 con 0x7f8320003a70 2024-09-11T00:58:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f832c03e070 con 0x7f8320003a70 2024-09-11T00:58:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c02f690 con 0x7f8320003a70 2024-09-11T00:58:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c1f0770 con 0x7f8320003a70 2024-09-11T00:58:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.874+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1f0d30 con 0x7f8320003a70 2024-09-11T00:58:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.875+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c1f0560 con 0x7f8320003a70 2024-09-11T00:58:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.876+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f832c02f830 con 0x7f8320003a70 2024-09-11T00:58:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.878+0000 7f8338c00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 0x7f831c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.878+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f832c0baf90 con 0x7f8320003a70 2024-09-11T00:58:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.878+0000 7f833be00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 0x7f831c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.879+0000 7f833be00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 0x7f831c07a460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8328001880 tx=0x7f8328001d20 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:23.882+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f832c083680 con 0x7f8320003a70 2024-09-11T00:58:24.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.100+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f833c15aeb0 con 0x7f8320003a70 2024-09-11T00:58:24.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.100+0000 7f8338c00640 1 -- 172.21.15.81:0/16099505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f832c082f80 con 0x7f8320003a70 2024-09-11T00:58:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:58:24.103 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:58:24.103 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:58:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 msgr2=0x7f831c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 0x7f831c07a460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8328001880 tx=0x7f8328001d20 comp rx=0 tx=0).stop 2024-09-11T00:58:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 msgr2=0x7f833c1e3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f832c00bc40 tx=0x7f832c031430 comp rx=0 tx=0).stop 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 shutdown_connections 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f831c077fa0 0x7f831c07a460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833c157b50 0x7f833c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f833c1f1250 0x7f833c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 --2- 172.21.15.81:0/16099505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8320003a70 0x7f833c1e3840 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 >> 172.21.15.81:0/16099505 conn(0x7f833c06ffd0 msgr2=0x7f833c153810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 shutdown_connections 2024-09-11T00:58:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.103+0000 7f8341e00640 1 -- 172.21.15.81:0/16099505 wait complete. 2024-09-11T00:58:24.120 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 528ec57a --release --await' 2024-09-11T00:58:24.120 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 528ec57a --release --await 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 -- 172.21.15.81:0/2760218586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff838003a50 msgr2=0x7ff838003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 --2- 172.21.15.81:0/2760218586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff838003a50 0x7ff838003e70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff84400abb0 tx=0x7ff838005830 comp rx=0 tx=0).stop 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff853e00640 1 -- 172.21.15.81:0/2760218586 reap_dead start 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 -- 172.21.15.81:0/2760218586 shutdown_connections 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 -- 172.21.15.81:0/2760218586 >> 172.21.15.81:0/2760218586 conn(0x7ff8540c8990 msgr2=0x7ff8540c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 -- 172.21.15.81:0/2760218586 shutdown_connections 2024-09-11T00:58:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.287+0000 7ff858e00640 1 -- 172.21.15.81:0/2760218586 wait complete. 2024-09-11T00:58:24.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.289+0000 7ff858e00640 1 Processor -- start 2024-09-11T00:58:24.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.289+0000 7ff858e00640 1 -- start start 2024-09-11T00:58:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff838003a50 0x7ff8541584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 0x7ff85415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff85406e750 con 0x7ff85415a540 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541576d0 con 0x7ff85414a850 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff858e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff85406ea30 con 0x7ff838003a50 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58728/0 (socket says 172.21.15.81:58728) 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853e00640 1 -- 172.21.15.81:0/1485179274 learned_addr learned my addr 172.21.15.81:0/1485179274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853400640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff838003a50 0x7ff8541584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff852a00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 0x7ff85415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853e00640 1 -- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff838003a50 msgr2=0x7ff8541584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.290+0000 7ff853e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff838003a50 0x7ff8541584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff853e00640 1 -- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 msgr2=0x7ff85415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff853e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 0x7ff85415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff853e00640 1 -- 172.21.15.81:0/1485179274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8541f06c0 con 0x7ff85415a540 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff852a00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 0x7ff85415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff853e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff84c011b20 tx=0x7ff84c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff84b400640 1 -- 172.21.15.81:0/1485179274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c004b20 con 0x7ff85415a540 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff84b400640 1 -- 172.21.15.81:0/1485179274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c004cc0 con 0x7ff85415a540 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8541f09a0 con 0x7ff85415a540 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff84b400640 1 -- 172.21.15.81:0/1485179274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c003bb0 con 0x7ff85415a540 2024-09-11T00:58:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.291+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8541f0f60 con 0x7ff85415a540 2024-09-11T00:58:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.294+0000 7ff84b400640 1 -- 172.21.15.81:0/1485179274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff84c021030 con 0x7ff85415a540 2024-09-11T00:58:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.295+0000 7ff84b400640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 0x7ff83407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.295+0000 7ff84b400640 1 -- 172.21.15.81:0/1485179274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff84c09a9d0 con 0x7ff85415a540 2024-09-11T00:58:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.295+0000 7ff85d479740 1 Processor -- start 2024-09-11T00:58:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 -- start start 2024-09-11T00:58:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff853400640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 0x7ff83407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac24231d90 0x55ac2427ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2422eb20 0x55ac24269ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac241a6370 con 0x55ac24273a20 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ac241957a0 con 0x55ac24231d90 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.296+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ac241995b0 con 0x55ac2422eb20 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff853400640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 0x7ff83407a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff844035000 tx=0x7ff84402d040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58734/0 (socket says 172.21.15.81:58734) 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 -- 172.21.15.81:0/3573938947 learned_addr learned my addr 172.21.15.81:0/3573938947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff853400640 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac24231d90 0x55ac2427ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff853e00640 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2422eb20 0x55ac24269ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 -- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2422eb20 msgr2=0x55ac24269ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2422eb20 0x55ac24269ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 -- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac24231d90 msgr2=0x55ac2427ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac24231d90 0x55ac2427ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 -- 172.21.15.81:0/3573938947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2412e010 con 0x55ac24273a20 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.297+0000 7ff852a00640 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff840006e70 tx=0x7ff840006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ba287dd6bfd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff83fe00640 1 -- 172.21.15.81:0/3573938947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840003bd0 con 0x55ac24273a20 2024-09-11T00:58:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff83fe00640 1 -- 172.21.15.81:0/3573938947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff840016030 con 0x55ac24273a20 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff83fe00640 1 -- 172.21.15.81:0/3573938947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840012440 con 0x55ac24273a20 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 -- 172.21.15.81:0/3573938947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 msgr2=0x55ac242695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff840006e70 tx=0x7ff840006430 comp rx=0 tx=0).stop 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 -- 172.21.15.81:0/3573938947 shutdown_connections 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2422eb20 0x55ac24269ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242695a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 --2- 172.21.15.81:0/3573938947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac24231d90 0x55ac2427ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 -- 172.21.15.81:0/3573938947 >> 172.21.15.81:0/3573938947 conn(0x55ac2422ff70 msgr2=0x55ac24231450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 -- 172.21.15.81:0/3573938947 shutdown_connections 2024-09-11T00:58:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.298+0000 7ff85d479740 1 -- 172.21.15.81:0/3573938947 wait complete. 2024-09-11T00:58:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.299+0000 7ff85d479740 1 -- start start 2024-09-11T00:58:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.299+0000 7ff85d479740 1 Processor -- start 2024-09-11T00:58:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24273a20 0x55ac2426f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac2426a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ac2413cf70 con 0x55ac24231d90 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ac2413b090 con 0x55ac2426c780 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ac2426d190 con 0x55ac24273a20 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff85d479740 10 client.0 _ll_register_callbacks cb 0x55ac23ea4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff853400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff853400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58736/0 (socket says 172.21.15.81:58736) 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.300+0000 7ff853400640 1 -- 172.21.15.81:0/567097883 learned_addr learned my addr 172.21.15.81:0/567097883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff852a00640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24273a20 0x55ac2426f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853e00640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac2426a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 -- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24273a20 msgr2=0x55ac2426f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24273a20 0x55ac2426f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 -- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 msgr2=0x55ac2426a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac2426a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 -- 172.21.15.81:0/567097883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac23ef7ea0 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff853400640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff84400acd0 tx=0x7ff8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ea5749cc6b93aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff83cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84404d070 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff844033440 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.301+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840016030 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff844058050 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 10 client.5412 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ac23f70d30 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff840016030 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff84405b020 con 0x55ac24231d90 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 10 client.5412 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 10 client.5412 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 20 client.5412 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac2426b1e0 0x55ac24283e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 4 client.5412 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.302+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac241a82c0 con 0x55ac2426b1e0 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.303+0000 7ff852a00640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac2426b1e0 0x55ac24283e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.303+0000 7ff852a00640 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac2426b1e0 0x55ac24283e00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c9793dd34ada84 server_cookie=828641ce6e7dc0f9 in_seq=0 out_seq=0 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.303+0000 7ff83cc00640 10 client.5412 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.304+0000 7ff83cc00640 1 -- 172.21.15.81:0/567097883 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac241a82c0 con 0x55ac2426b1e0 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.304+0000 7ff83cc00640 10 client.5412 handle_command_reply: tid=0 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.304+0000 7ff85d479740 1 client.5412 shutdown 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 msgr2=0x55ac242754e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff84400acd0 tx=0x7ff8440046c0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 shutdown_connections 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac2426b1e0 0x55ac24283e00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac2426a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24273a20 0x55ac2426f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff83cc00640 0 client.5412 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 --2- 172.21.15.81:0/567097883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24231d90 0x55ac242754e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 >> 172.21.15.81:0/567097883 conn(0x55ac2422eb20 msgr2=0x55ac24230d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 shutdown_connections 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 1 -- 172.21.15.81:0/567097883 wait complete. 2024-09-11T00:58:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.305+0000 7ff85d479740 20 client.5412 trim_cache size 0 max 16384 2024-09-11T00:58:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 Processor -- start 2024-09-11T00:58:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 -- start start 2024-09-11T00:58:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242983f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac24230c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541ff990 con 0x55ac24273a20 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541fe870 con 0x55ac2426c780 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.323+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff8541f4720 con 0x55ac24231d90 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58738/0 (socket says 172.21.15.81:58738) 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 -- 172.21.15.81:0/1305154561 learned_addr learned my addr 172.21.15.81:0/1305154561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853400640 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff852a00640 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac24230c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 -- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 msgr2=0x55ac242983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 -- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 msgr2=0x55ac24230c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac24230c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 -- 172.21.15.81:0/1305154561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2426fd40 con 0x55ac24273a20 2024-09-11T00:58:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.324+0000 7ff853e00640 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff84c098af0 tx=0x7ff84c067040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb66fbb3c28b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff83f400640 1 -- 172.21.15.81:0/1305154561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c067410 con 0x55ac24273a20 2024-09-11T00:58:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff83f400640 1 -- 172.21.15.81:0/1305154561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c06bec0 con 0x55ac24273a20 2024-09-11T00:58:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff83f400640 1 -- 172.21.15.81:0/1305154561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c061b90 con 0x55ac24273a20 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 -- 172.21.15.81:0/1305154561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 msgr2=0x55ac242311d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff84c098af0 tx=0x7ff84c067040 comp rx=0 tx=0).stop 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 -- 172.21.15.81:0/1305154561 shutdown_connections 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac242311d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac24230c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 --2- 172.21.15.81:0/1305154561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 -- 172.21.15.81:0/1305154561 >> 172.21.15.81:0/1305154561 conn(0x55ac2422eb20 msgr2=0x55ac24277780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 -- 172.21.15.81:0/1305154561 shutdown_connections 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.325+0000 7ff85d479740 1 -- 172.21.15.81:0/1305154561 wait complete. 2024-09-11T00:58:24.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.326+0000 7ff85d479740 1 -- start start 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.326+0000 7ff85d479740 1 Processor -- start 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac242ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541fd520 con 0x55ac24273a20 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541fe1c0 con 0x55ac2426c780 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff8541fdb70 con 0x55ac24231d90 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff85d479740 10 client.0 _ll_register_callbacks cb 0x7ff84c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff853e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58746/0 (socket says 172.21.15.81:58746) 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff853e00640 1 -- 172.21.15.81:0/669813434 learned_addr learned my addr 172.21.15.81:0/669813434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff852a00640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac242ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.327+0000 7ff853400640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 -- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 msgr2=0x55ac242f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 -- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 msgr2=0x55ac242ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac242ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 -- 172.21.15.81:0/669813434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2426ab40 con 0x55ac24273a20 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff853e00640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff84c062630 tx=0x7ff84c062ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4061a0e6918fbec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff83cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c081060 con 0x55ac24273a20 2024-09-11T00:58:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff84c061d90 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff84c06bec0 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff84c067410 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff85d479740 10 client.5418 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.328+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ac2428b6d0 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c06bec0 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff84c084b00 con 0x55ac24273a20 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 10 client.5418 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 10 client.5418 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 20 client.5418 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac24231150 0x55ac242641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 4 client.5418 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "528ec57a", "release": true, "await": true}] 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "528ec57a", "release": true, "await": true}) -- 0x55ac241a3d70 con 0x55ac24231150 2024-09-11T00:58:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.329+0000 7ff853400640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac24231150 0x55ac242641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.330+0000 7ff853400640 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac24231150 0x55ac242641b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12bd05b224b8e3a server_cookie=c5ddb45a25638b77 in_seq=0 out_seq=0 2024-09-11T00:58:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.330+0000 7ff83cc00640 10 client.5418 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.348+0000 7ff83cc00640 1 -- 172.21.15.81:0/669813434 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ac241a3d70 con 0x55ac24231150 2024-09-11T00:58:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.348+0000 7ff83cc00640 10 client.5418 handle_command_reply: tid=0 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.348+0000 7ff85d479740 1 client.5418 shutdown 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.348+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 msgr2=0x55ac24230c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.348+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff84c062630 tx=0x7ff84c062ab0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 shutdown_connections 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ac24231150 0x55ac242641b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ac24273a20 0x55ac24230c10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff83cc00640 0 client.5418 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2426c780 0x55ac242ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 --2- 172.21.15.81:0/669813434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac24231d90 0x55ac242f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 >> 172.21.15.81:0/669813434 conn(0x55ac2422eb20 msgr2=0x55ac24229780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 shutdown_connections 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 1 -- 172.21.15.81:0/669813434 wait complete. 2024-09-11T00:58:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff85d479740 20 client.5418 trim_cache size 0 max 16384 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 44, 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "528ec57a": { 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 44, 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:58:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 142.8, 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:24.354 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 msgr2=0x7ff83407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 0x7ff83407a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff844035000 tx=0x7ff84402d040 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.349+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 msgr2=0x7ff854149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff84c011b20 tx=0x7ff84c00f3c0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 shutdown_connections 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff834077f70 0x7ff83407a430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff85415a540 0x7ff854149cf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85414a850 0x7ff85415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 --2- 172.21.15.81:0/1485179274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff838003a50 0x7ff8541584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 >> 172.21.15.81:0/1485179274 conn(0x7ff8540c8990 msgr2=0x7ff85414e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 shutdown_connections 2024-09-11T00:58:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.350+0000 7ff858e00640 1 -- 172.21.15.81:0/1485179274 wait complete. 2024-09-11T00:58:24.370 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '528ec57a', total seconds elapsed: 23.4 2024-09-11T00:58:24.370 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-11T00:58:24.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 -- 172.21.15.81:0/2958546418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2815b860 msgr2=0x7f6d2815bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2958546418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2815b860 0x7f6d2815bd10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d28073de0 tx=0x7f6d2002aac0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 -- 172.21.15.81:0/2958546418 shutdown_connections 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2958546418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2815b860 0x7f6d2815bd10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2958546418 >> v2:172.21.15.167:3300/0 conn(0x7f6d28072420 0x7f6d28072840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2958546418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2814ec70 0x7f6d280c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 -- 172.21.15.81:0/2958546418 >> 172.21.15.81:0/2958546418 conn(0x7f6d280cdf20 msgr2=0x7f6d280ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 -- 172.21.15.81:0/2958546418 shutdown_connections 2024-09-11T00:58:24.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.546+0000 7f6d2e400640 1 -- 172.21.15.81:0/2958546418 wait complete. 2024-09-11T00:58:24.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.548+0000 7f6d2e400640 1 Processor -- start 2024-09-11T00:58:24.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.548+0000 7f6d2e400640 1 -- start start 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d2814ec70 0x7f6d280cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2815b860 0x7f6d280cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280c3e90 con 0x7f6d28072420 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280c9220 con 0x7f6d2814ec70 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2814f050 con 0x7f6d2815b860 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58770/0 (socket says 172.21.15.81:58770) 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.549+0000 7f6d2d000640 1 -- 172.21.15.81:0/2914154380 learned_addr learned my addr 172.21.15.81:0/2914154380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d27e00640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d2814ec70 0x7f6d280cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2da00640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2815b860 0x7f6d280cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 -- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2815b860 msgr2=0x7f6d280cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2815b860 0x7f6d280cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 -- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d2814ec70 msgr2=0x7f6d280cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d2814ec70 0x7f6d280cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 -- 172.21.15.81:0/2914154380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d28145c30 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d2d000640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00d950 tx=0x7f6d1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.550+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c017070 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.551+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d1c009d20 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.551+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d28152640 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.551+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0106c0 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.551+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d28152160 con 0x7f6d28072420 2024-09-11T00:58:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.552+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d280b3d30 con 0x7f6d28072420 2024-09-11T00:58:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.553+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6d1c010860 con 0x7f6d28072420 2024-09-11T00:58:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.554+0000 7f6d24c00640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 0x7f6d0807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.554+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6d1c09a570 con 0x7f6d28072420 2024-09-11T00:58:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.555+0000 7f6d27e00640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 0x7f6d0807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.555+0000 7f6d27e00640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 0x7f6d0807a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d28070c80 tx=0x7f6d1400b310 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:24.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.559+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6d1c062610 con 0x7f6d28072420 2024-09-11T00:58:24.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.789+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d280c4980 con 0x7f6d28072420 2024-09-11T00:58:24.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.790+0000 7f6d24c00640 1 -- 172.21.15.81:0/2914154380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f6d1c067040 con 0x7f6d28072420 2024-09-11T00:58:24.791 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:58:24.791 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:58:24.791 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 msgr2=0x7f6d0807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 0x7f6d0807a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d28070c80 tx=0x7f6d1400b310 comp rx=0 tx=0).stop 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 msgr2=0x7f6d28149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00d950 tx=0x7f6d1c00de10 comp rx=0 tx=0).stop 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 shutdown_connections 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6d08077f70 0x7f6d0807a430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d2815b860 0x7f6d280cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d2814ec70 0x7f6d280cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 --2- 172.21.15.81:0/2914154380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d28072420 0x7f6d28149860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:24.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.792+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 >> 172.21.15.81:0/2914154380 conn(0x7f6d280cdf20 msgr2=0x7f6d2815bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:24.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.793+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 shutdown_connections 2024-09-11T00:58:24.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:24.793+0000 7f6d2e400640 1 -- 172.21.15.81:0/2914154380 wait complete. 2024-09-11T00:58:24.811 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-11T00:58:24.812 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-11T00:58:25.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.001+0000 7f69a4a00640 1 -- 172.21.15.81:0/1542826801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a00cb380 msgr2=0x7f69a00d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.001+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1542826801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a00cb380 0x7f69a00d02e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f69a00b3160 tx=0x7f699802a940 comp rx=0 tx=0).stop 2024-09-11T00:58:25.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 -- 172.21.15.81:0/1542826801 shutdown_connections 2024-09-11T00:58:25.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1542826801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a00cb380 0x7f69a00d02e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1542826801 >> v2:172.21.15.167:3300/0 conn(0x7f69a015b050 0x7f69a00cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 -- 172.21.15.81:0/1542826801 >> 172.21.15.81:0/1542826801 conn(0x7f69a0068ac0 msgr2=0x7f69a0068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 -- 172.21.15.81:0/1542826801 shutdown_connections 2024-09-11T00:58:25.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.002+0000 7f69a4a00640 1 -- 172.21.15.81:0/1542826801 wait complete. 2024-09-11T00:58:25.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.004+0000 7f69a4a00640 1 Processor -- start 2024-09-11T00:58:25.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.004+0000 7f69a4a00640 1 -- start start 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a00cb380 0x7f69a014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69a015b050 0x7f69a01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69a00c4f40 con 0x7f69a0154880 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69a00cccd0 con 0x7f69a00cb380 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f69a4a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69a00c50c0 con 0x7f69a015b050 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58792/0 (socket says 172.21.15.81:58792) 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 -- 172.21.15.81:0/1131950410 learned_addr learned my addr 172.21.15.81:0/1131950410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699fe00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69a015b050 0x7f69a01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699f400640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a00cb380 0x7f69a014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 -- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69a015b050 msgr2=0x7f69a01528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69a015b050 0x7f69a01528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 -- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a00cb380 msgr2=0x7f69a014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a00cb380 0x7f69a014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.005+0000 7f699ea00640 1 -- 172.21.15.81:0/1131950410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a01f1780 con 0x7f69a0154880 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f699ea00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e7c0 tx=0x7f698c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f6997400640 1 -- 172.21.15.81:0/1131950410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c00ccc0 con 0x7f69a0154880 2024-09-11T00:58:25.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a01f1a60 con 0x7f69a0154880 2024-09-11T00:58:25.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f6997400640 1 -- 172.21.15.81:0/1131950410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698c010430 con 0x7f69a0154880 2024-09-11T00:58:25.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f6997400640 1 -- 172.21.15.81:0/1131950410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c010860 con 0x7f69a0154880 2024-09-11T00:58:25.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.006+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a01e5790 con 0x7f69a0154880 2024-09-11T00:58:25.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.009+0000 7f6997400640 1 -- 172.21.15.81:0/1131950410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f698c010a00 con 0x7f69a0154880 2024-09-11T00:58:25.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.010+0000 7f6997400640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 0x7f698007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.010+0000 7f6997400640 1 -- 172.21.15.81:0/1131950410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f698c09aaa0 con 0x7f69a0154880 2024-09-11T00:58:25.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.010+0000 7f69a8ec3740 1 Processor -- start 2024-09-11T00:58:25.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.010+0000 7f699f400640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 0x7f698007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.011+0000 7f69a8ec3740 1 -- start start 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.011+0000 7f699f400640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 0x7f698007a460 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6990001700 tx=0x7f6990009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.011+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 0x55b5b63a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.011+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a8b50 0x55b5b63a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5b631d240 con 0x55b5b63a5a10 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5b630c670 con 0x55b5b63a8b50 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b5b6310480 con 0x55b5b63a81b0 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58794/0 (socket says 172.21.15.81:58794) 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 -- 172.21.15.81:0/2539628323 learned_addr learned my addr 172.21.15.81:0/2539628323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:25.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699ea00640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a8b50 0x55b5b63a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699f400640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 0x55b5b63a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 -- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 msgr2=0x55b5b63a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 0x55b5b63a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 -- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a8b50 msgr2=0x55b5b63a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a8b50 0x55b5b63a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699fe00640 1 -- 172.21.15.81:0/2539628323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b60e6de0 con 0x55b5b63a5a10 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.012+0000 7f699f400640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 0x55b5b63a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:25.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.013+0000 7f699fe00640 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6998009ca0 tx=0x7f6998004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d628cb30ca5397 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.013+0000 7f698b400640 1 -- 172.21.15.81:0/2539628323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998003c70 con 0x55b5b63a5a10 2024-09-11T00:58:25.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.013+0000 7f698b400640 1 -- 172.21.15.81:0/2539628323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998003e10 con 0x55b5b63a5a10 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.013+0000 7f698b400640 1 -- 172.21.15.81:0/2539628323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998004260 con 0x55b5b63a5a10 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2539628323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 msgr2=0x55b5b63aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6998009ca0 tx=0x7f6998004a40 comp rx=0 tx=0).stop 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2539628323 shutdown_connections 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a5a10 0x55b5b63aa100 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a8b50 0x55b5b63a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2539628323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a81b0 0x55b5b63a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2539628323 >> 172.21.15.81:0/2539628323 conn(0x55b5b63a6350 msgr2=0x55b5b63a7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2539628323 shutdown_connections 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.014+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2539628323 wait complete. 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.015+0000 7f69a8ec3740 1 -- start start 2024-09-11T00:58:25.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.015+0000 7f69a8ec3740 1 Processor -- start 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 0x55b5b63db5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5b607cd20 con 0x55b5b63e8920 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5b62b1dd0 con 0x55b5b63a81b0 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b5b63a4e10 con 0x55b5b63a8b50 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f69a8ec3740 10 client.0 _ll_register_callbacks cb 0x55b5b601a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:25.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f699fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f699fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58810/0 (socket says 172.21.15.81:58810) 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f699fe00640 1 -- 172.21.15.81:0/4228480175 learned_addr learned my addr 172.21.15.81:0/4228480175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f699f400640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.016+0000 7f699ea00640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 0x55b5b63db5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 -- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 msgr2=0x55b5b63db5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 0x55b5b63db5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 -- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 msgr2=0x55b5b63fddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63fddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 -- 172.21.15.81:0/4228480175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b6147570 con 0x55b5b63e8920 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699ea00640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 0x55b5b63db5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f699fe00640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f699802af30 tx=0x7f6998043ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff1147eb92d5c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f697fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998049070 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5b6325700 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.017+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f6998039630 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6998057050 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 10 client.5439 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b5b604bc80 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b5b6325700 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f699805a020 con 0x55b5b63e8920 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 10 client.5439 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 10 client.5439 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 20 client.5439 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b63d6860 0x55b5b63d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 4 client.5439 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:58:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.018+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b631f190 con 0x55b5b63d6860 2024-09-11T00:58:25.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.019+0000 7f699f400640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b63d6860 0x55b5b63d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.019+0000 7f697fe00640 10 client.5439 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.019+0000 7f699f400640 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b63d6860 0x55b5b63d9dd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d5768e3f62aefc server_cookie=5388edf5b75b0765 in_seq=0 out_seq=0 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.020+0000 7f697fe00640 1 -- 172.21.15.81:0/4228480175 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5b631f190 con 0x55b5b63d6860 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.020+0000 7f697fe00640 10 client.5439 handle_command_reply: tid=0 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.020+0000 7f69a8ec3740 1 client.5439 shutdown 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 msgr2=0x55b5b63d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f699802af30 tx=0x7f6998043ae0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 shutdown_connections 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b63d6860 0x55b5b63d9dd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63e8920 0x55b5b63d4510 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b63a8b50 0x55b5b63db5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/4228480175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 >> 172.21.15.81:0/4228480175 conn(0x55b5b63a5a10 msgr2=0x55b5b63e02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f697fe00640 0 client.5439 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 shutdown_connections 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 1 -- 172.21.15.81:0/4228480175 wait complete. 2024-09-11T00:58:25.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.021+0000 7f69a8ec3740 20 client.5439 trim_cache size 0 max 16384 2024-09-11T00:58:25.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.039+0000 7f69a8ec3740 1 Processor -- start 2024-09-11T00:58:25.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.039+0000 7f69a8ec3740 1 -- start start 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b640e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01ff350 con 0x55b5b63a8b50 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01fe230 con 0x55b5b63a81b0 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69a01f4ad0 con 0x55b5b640e420 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58816/0 (socket says 172.21.15.81:58816) 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f699ea00640 1 -- 172.21.15.81:0/1486285575 learned_addr learned my addr 172.21.15.81:0/1486285575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:25.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f699f400640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.040+0000 7f699fe00640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b640e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 -- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 msgr2=0x55b5b640e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b640e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 -- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 msgr2=0x55b5b63a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 -- 172.21.15.81:0/1486285575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b63ee380 con 0x55b5b63a8b50 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699fe00640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b640e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:58:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f699ea00640 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c6a0 tx=0x7f698c05f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e255888b319c537a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f698aa00640 1 -- 172.21.15.81:0/1486285575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c062b40 con 0x55b5b63a8b50 2024-09-11T00:58:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f698aa00640 1 -- 172.21.15.81:0/1486285575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698c067620 con 0x55b5b63a8b50 2024-09-11T00:58:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.041+0000 7f698aa00640 1 -- 172.21.15.81:0/1486285575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c06c040 con 0x55b5b63a8b50 2024-09-11T00:58:25.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 -- 172.21.15.81:0/1486285575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 msgr2=0x55b5b63a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c6a0 tx=0x7f698c05f190 comp rx=0 tx=0).stop 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 -- 172.21.15.81:0/1486285575 shutdown_connections 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b640e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63a7630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/1486285575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b63a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 -- 172.21.15.81:0/1486285575 >> 172.21.15.81:0/1486285575 conn(0x55b5b63a5a10 msgr2=0x55b5b63e9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 -- 172.21.15.81:0/1486285575 shutdown_connections 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.042+0000 7f69a8ec3740 1 -- 172.21.15.81:0/1486285575 wait complete. 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.043+0000 7f69a8ec3740 1 -- start start 2024-09-11T00:58:25.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.043+0000 7f69a8ec3740 1 Processor -- start 2024-09-11T00:58:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b646b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b6465510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01fcf90 con 0x55b5b63a8b50 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01fdba0 con 0x55b5b63a81b0 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69a01fd550 con 0x55b5b640e420 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f69a8ec3740 10 client.0 _ll_register_callbacks cb 0x7f698c00eed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f699ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58822/0 (socket says 172.21.15.81:58822) 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.044+0000 7f699ea00640 1 -- 172.21.15.81:0/2658742149 learned_addr learned my addr 172.21.15.81:0/2658742149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 -- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 msgr2=0x55b5b6465510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b6465510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 -- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 msgr2=0x55b5b646b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699f400640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b646b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b646b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 -- 172.21.15.81:0/2658742149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b646bcf0 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699f400640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b646b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f699ea00640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f698c05fdb0 tx=0x7f698c010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0f929e948923fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f697fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c081060 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f698c061fa0 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f698c067620 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f698c0673f0 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f69a8ec3740 10 client.5445 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.045+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b5b646fb30 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698c067620 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f698c05e490 con 0x55b5b63a8b50 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 10 client.5445 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:25.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 10 client.5445 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 20 client.5445 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b6465a50 0x55b5b63a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 4 client.5445 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x55b5b631ac40 con 0x55b5b6465a50 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.046+0000 7f699f400640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b6465a50 0x55b5b63a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.047+0000 7f699f400640 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b6465a50 0x55b5b63a3220 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7239e233a37d7acc server_cookie=aa5ae83f43221b24 in_seq=0 out_seq=0 2024-09-11T00:58:25.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.047+0000 7f697fe00640 10 client.5445 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f697fe00640 1 -- 172.21.15.81:0/2658742149 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b5b631ac40 con 0x55b5b6465a50 2024-09-11T00:58:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f697fe00640 10 client.5445 handle_command_reply: tid=0 2024-09-11T00:58:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 client.5445 shutdown 2024-09-11T00:58:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 msgr2=0x55b5b63d7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f698c05fdb0 tx=0x7f698c010f50 comp rx=0 tx=0).stop 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 shutdown_connections 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b5b6465a50 0x55b5b63a3220 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b5b640e420 0x55b5b6465510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5b63a8b50 0x55b5b63d7090 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f697fe00640 0 client.5445 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 --2- 172.21.15.81:0/2658742149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5b63a81b0 0x55b5b646b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.120+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 >> 172.21.15.81:0/2658742149 conn(0x55b5b63a5a10 msgr2=0x55b5b63dd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 shutdown_connections 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a8ec3740 1 -- 172.21.15.81:0/2658742149 wait complete. 2024-09-11T00:58:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a8ec3740 20 client.5445 trim_cache size 0 max 16384 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 46, 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "780d0044": { 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 46, 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:25.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 142.8, 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:25.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:25.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:25.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:25.126 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:58:25.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 msgr2=0x7f698007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 0x7f698007a460 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6990001700 tx=0x7f6990009040 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 msgr2=0x7f69a0152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e7c0 tx=0x7f698c00ec80 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 shutdown_connections 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6980077fa0 0x7f698007a460 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69a015b050 0x7f69a01528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69a0154880 0x7f69a0152380 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 --2- 172.21.15.81:0/1131950410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a00cb380 0x7f69a014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.121+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 >> 172.21.15.81:0/1131950410 conn(0x7f69a0068ac0 msgr2=0x7f69a01e2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.122+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 shutdown_connections 2024-09-11T00:58:25.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:25.122+0000 7f69a4a00640 1 -- 172.21.15.81:0/1131950410 wait complete. 2024-09-11T00:58:25.138 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '780d0044', quiesce took 0.8 seconds. Will release after: 21.95 2024-09-11T00:58:47.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 -- 172.21.15.81:0/1510981702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78004d40 msgr2=0x7fca780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 --2- 172.21.15.81:0/1510981702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78004d40 0x7fca780051c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca940711b0 tx=0x7fca78005830 comp rx=0 tx=0).stop 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca99c00640 1 -- 172.21.15.81:0/1510981702 reap_dead start 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 -- 172.21.15.81:0/1510981702 shutdown_connections 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 -- 172.21.15.81:0/1510981702 >> 172.21.15.81:0/1510981702 conn(0x7fca940700f0 msgr2=0x7fca94070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 -- 172.21.15.81:0/1510981702 shutdown_connections 2024-09-11T00:58:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.258+0000 7fca9bc00640 1 -- 172.21.15.81:0/1510981702 wait complete. 2024-09-11T00:58:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.260+0000 7fca9bc00640 1 Processor -- start 2024-09-11T00:58:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.260+0000 7fca9bc00640 1 -- start start 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.260+0000 7fca9bc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca78004d40 0x7fca94073d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.260+0000 7fca9bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca94147d90 0x7fca94158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca9bc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca9bc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca94070cf0 con 0x7fca941f40e0 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca9bc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca9415c140 con 0x7fca78004d40 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca9bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca940c8090 con 0x7fca94147d90 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51654/0 (socket says 172.21.15.81:51654) 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 -- 172.21.15.81:0/508691093 learned_addr learned my addr 172.21.15.81:0/508691093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca93e00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca94147d90 0x7fca94158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99200640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca78004d40 0x7fca94073d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 -- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca94147d90 msgr2=0x7fca94158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca94147d90 0x7fca94158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 -- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca78004d40 msgr2=0x7fca94073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca78004d40 0x7fca94073d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 -- 172.21.15.81:0/508691093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9415a620 con 0x7fca941f40e0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.261+0000 7fca99c00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009c10 tx=0x7fca8c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.262+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c040020 con 0x7fca941f40e0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.262+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca8c0337d0 con 0x7fca941f40e0 2024-09-11T00:58:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.262+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c038040 con 0x7fca941f40e0 2024-09-11T00:58:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.262+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca941f3920 con 0x7fca941f40e0 2024-09-11T00:58:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.262+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca941571f0 con 0x7fca941f40e0 2024-09-11T00:58:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.263+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca941529f0 con 0x7fca941f40e0 2024-09-11T00:58:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.264+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca8c03b050 con 0x7fca941f40e0 2024-09-11T00:58:47.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.265+0000 7fca90c00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 0x7fca7407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.265+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fca8c0ba120 con 0x7fca941f40e0 2024-09-11T00:58:47.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.265+0000 7fca99200640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 0x7fca7407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.266+0000 7fca99200640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 0x7fca7407a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca84005fd0 tx=0x7fca84009500 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.269+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca8c04a020 con 0x7fca941f40e0 2024-09-11T00:58:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.487+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca940c7530 con 0x7fca941f40e0 2024-09-11T00:58:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.487+0000 7fca90c00640 1 -- 172.21.15.81:0/508691093 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fca9415a620 con 0x7fca941f40e0 2024-09-11T00:58:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T00:58:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T00:58:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T00:58:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 msgr2=0x7fca7407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 0x7fca7407a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca84005fd0 tx=0x7fca84009500 comp rx=0 tx=0).stop 2024-09-11T00:58:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 msgr2=0x7fca941f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009c10 tx=0x7fca8c033670 comp rx=0 tx=0).stop 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 shutdown_connections 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fca74077f70 0x7fca7407a430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca941f40e0 0x7fca941f4560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca94147d90 0x7fca94158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 --2- 172.21.15.81:0/508691093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca78004d40 0x7fca94073d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 >> 172.21.15.81:0/508691093 conn(0x7fca940700f0 msgr2=0x7fca9406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 shutdown_connections 2024-09-11T00:58:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.490+0000 7fca9bc00640 1 -- 172.21.15.81:0/508691093 wait complete. 2024-09-11T00:58:47.508 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 780d0044 --release --await' 2024-09-11T00:58:47.509 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 780d0044 --release --await 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 -- 172.21.15.81:0/2822756529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80725a0 msgr2=0x7f8de8072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 --2- 172.21.15.81:0/2822756529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80725a0 0x7f8de8072a10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8de0005fd0 tx=0x7f8de002a540 comp rx=0 tx=0).stop 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 -- 172.21.15.81:0/2822756529 shutdown_connections 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 --2- 172.21.15.81:0/2822756529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80725a0 0x7f8de8072a10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 --2- 172.21.15.81:0/2822756529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 0x7f8de8070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 -- 172.21.15.81:0/2822756529 >> 172.21.15.81:0/2822756529 conn(0x7f8de806ff90 msgr2=0x7f8de80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 -- 172.21.15.81:0/2822756529 shutdown_connections 2024-09-11T00:58:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.670+0000 7f8dee200640 1 -- 172.21.15.81:0/2822756529 wait complete. 2024-09-11T00:58:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.672+0000 7f8dee200640 1 Processor -- start 2024-09-11T00:58:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.672+0000 7f8dee200640 1 -- start start 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 0x7f8de80b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8de80725a0 0x7f8de80c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8074db0 con 0x7f8de80c7360 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8de80c6bf0 con 0x7f8de80725a0 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8dee200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8de80c6e40 con 0x7f8de806f760 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2024-09-11T00:58:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8de7e00640 1 -- 172.21.15.81:0/2660944469 learned_addr learned my addr 172.21.15.81:0/2660944469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8de6a00640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8de80725a0 0x7f8de80c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.673+0000 7f8de7400640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 0x7f8de80b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 -- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 msgr2=0x7f8de80b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 0x7f8de80b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 -- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8de80725a0 msgr2=0x7f8de80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8de80725a0 0x7f8de80c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 -- 172.21.15.81:0/2660944469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81f1900 con 0x7f8de80c7360 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8de7e00640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006010 tx=0x7f8de0003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8ddf400640 1 -- 172.21.15.81:0/2660944469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de003f070 con 0x7f8de80c7360 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8ddf400640 1 -- 172.21.15.81:0/2660944469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de00047a0 con 0x7f8de80c7360 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de81f1620 con 0x7f8de80c7360 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.674+0000 7f8ddf400640 1 -- 172.21.15.81:0/2660944469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0035030 con 0x7f8de80c7360 2024-09-11T00:58:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.675+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de814b3b0 con 0x7f8de80c7360 2024-09-11T00:58:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.677+0000 7f8ddf400640 1 -- 172.21.15.81:0/2660944469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8de0004bf0 con 0x7f8de80c7360 2024-09-11T00:58:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.678+0000 7f8ddf400640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 0x7f8dc807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.678+0000 7f8ddf400640 1 -- 172.21.15.81:0/2660944469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8de00bb220 con 0x7f8de80c7360 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8df1258740 1 Processor -- start 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8de7400640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 0x7f8dc807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8df1258740 1 -- start start 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8de7400640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 0x7f8dc807a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd8009680 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 0x55ace4b80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.679+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8df1258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8df1258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ace4aaa370 con 0x55ace4b32910 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ace4a997a0 con 0x55ace4b35b80 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ace4a9d5b0 con 0x55ace4b77810 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51676/0 (socket says 172.21.15.81:51676) 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 -- 172.21.15.81:0/4051254623 learned_addr learned my addr 172.21.15.81:0/4051254623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de6a00640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7400640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 0x55ace4b80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 -- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 msgr2=0x55ace4b6d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 -- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 msgr2=0x55ace4b80c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 0x55ace4b80c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 -- 172.21.15.81:0/4051254623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace4a32010 con 0x55ace4b32910 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7400640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 0x55ace4b80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.680+0000 7f8de7e00640 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8de0083250 tx=0x7f8de007f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9a2d69a9cebda2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8dd3400640 1 -- 172.21.15.81:0/4051254623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0049040 con 0x55ace4b32910 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8dd3400640 1 -- 172.21.15.81:0/4051254623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de0082dd0 con 0x55ace4b32910 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8dd3400640 1 -- 172.21.15.81:0/4051254623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0082a30 con 0x55ace4b32910 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 -- 172.21.15.81:0/4051254623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 msgr2=0x55ace4b6d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8de0083250 tx=0x7f8de007f220 comp rx=0 tx=0).stop 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 -- 172.21.15.81:0/4051254623 shutdown_connections 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b32910 0x55ace4b6d8d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 --2- 172.21.15.81:0/4051254623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b35b80 0x55ace4b80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 -- 172.21.15.81:0/4051254623 >> 172.21.15.81:0/4051254623 conn(0x55ace4b33d60 msgr2=0x55ace4b35240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 -- 172.21.15.81:0/4051254623 shutdown_connections 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.681+0000 7f8df1258740 1 -- 172.21.15.81:0/4051254623 wait complete. 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.682+0000 7f8df1258740 1 -- start start 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.682+0000 7f8df1258740 1 Processor -- start 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b35b80 0x55ace4b6eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b6bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ace4a40f70 con 0x55ace4b6c770 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ace4a3f090 con 0x55ace4b77810 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55ace4aaa370 con 0x55ace4b35b80 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.683+0000 7f8df1258740 10 client.0 _ll_register_callbacks cb 0x55ace47a8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2024-09-11T00:58:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 -- 172.21.15.81:0/798763078 learned_addr learned my addr 172.21.15.81:0/798763078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7400640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b35b80 0x55ace4b6eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de6a00640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b6bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 -- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b35b80 msgr2=0x55ace4b6eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b35b80 0x55ace4b6eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 -- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 msgr2=0x55ace4b6bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b6bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 -- 172.21.15.81:0/798763078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace47fbea0 con 0x55ace4b6c770 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8de7e00640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8de0005c40 tx=0x7f8de008a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378b4fc058154b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0049070 con 0x55ace4b6c770 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8de008c490 con 0x55ace4b6c770 2024-09-11T00:58:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.684+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8de0082dd0 con 0x55ace4b6c770 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8de00b8050 con 0x55ace4b6c770 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 10 client.5463 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ace4874d30 con 0x55ace4b6c770 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de0082dd0 con 0x55ace4b6c770 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8de0082520 con 0x55ace4b6c770 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 10 client.5463 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 10 client.5463 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 20 client.5463 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b69c70 0x55ace4b6a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 4 client.5463 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ace4aac2c0 con 0x55ace4b69c70 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.685+0000 7f8de7400640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b69c70 0x55ace4b6a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.686+0000 7f8de7400640 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b69c70 0x55ace4b6a080 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12527ca981a319f1 server_cookie=e3b986fa43b6adfd in_seq=0 out_seq=0 2024-09-11T00:58:47.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.686+0000 7f8dc7e00640 10 client.5463 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8dc7e00640 1 -- 172.21.15.81:0/798763078 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ace4aac2c0 con 0x55ace4b69c70 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8dc7e00640 10 client.5463 handle_command_reply: tid=0 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 client.5463 shutdown 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 msgr2=0x55ace4b66790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8de0005c40 tx=0x7f8de008a220 comp rx=0 tx=0).stop 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 shutdown_connections 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b69c70 0x55ace4b6a080 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b6c770 0x55ace4b66790 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b6bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 --2- 172.21.15.81:0/798763078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b35b80 0x55ace4b6eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8dc7e00640 0 client.5463 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 >> 172.21.15.81:0/798763078 conn(0x55ace4b32910 msgr2=0x55ace4b34da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.687+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 shutdown_connections 2024-09-11T00:58:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.688+0000 7f8df1258740 1 -- 172.21.15.81:0/798763078 wait complete. 2024-09-11T00:58:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.688+0000 7f8df1258740 20 client.5463 trim_cache size 0 max 16384 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.705+0000 7f8df1258740 1 Processor -- start 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.705+0000 7f8df1258740 1 -- start start 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b6c770 0x55ace4b31270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81ff3b0 con 0x55ace4b35b80 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81fe290 con 0x55ace4b6c770 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8de81f4a30 con 0x55ace4b77810 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51696/0 (socket says 172.21.15.81:51696) 2024-09-11T00:58:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 -- 172.21.15.81:0/904933462 learned_addr learned my addr 172.21.15.81:0/904933462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 -- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 msgr2=0x55ace4b6e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 -- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b6c770 msgr2=0x55ace4b31270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.706+0000 7f8de7400640 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b6c770 0x55ace4b31270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8de7400640 1 -- 172.21.15.81:0/904933462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace4b608e0 con 0x55ace4b35b80 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8de7400640 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55ace4b76b80 tx=0x7f8dd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56992f416b778cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8dd2a00640 1 -- 172.21.15.81:0/904933462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd801f620 con 0x55ace4b35b80 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8dd2a00640 1 -- 172.21.15.81:0/904933462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dd801f8b0 con 0x55ace4b35b80 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8dd2a00640 1 -- 172.21.15.81:0/904933462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd801fcc0 con 0x55ace4b35b80 2024-09-11T00:58:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8df1258740 1 -- 172.21.15.81:0/904933462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 msgr2=0x55ace4b30d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.707+0000 7f8df1258740 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55ace4b76b80 tx=0x7f8dd8016000 comp rx=0 tx=0).stop 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 -- 172.21.15.81:0/904933462 shutdown_connections 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b77810 0x55ace4b6e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b6c770 0x55ace4b31270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 --2- 172.21.15.81:0/904933462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4b30d30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 -- 172.21.15.81:0/904933462 >> 172.21.15.81:0/904933462 conn(0x55ace4b32910 msgr2=0x55ace4b2d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 -- 172.21.15.81:0/904933462 shutdown_connections 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 -- 172.21.15.81:0/904933462 wait complete. 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 -- start start 2024-09-11T00:58:47.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.708+0000 7f8df1258740 1 Processor -- start 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b6c770 0x55ace4b6e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b9c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81fced0 con 0x55ace4b35b80 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81fdbc0 con 0x55ace4b77810 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8de81fd4f0 con 0x55ace4b6c770 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.709+0000 7f8df1258740 10 client.0 _ll_register_callbacks cb 0x7f8de007f910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:58:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51708/0 (socket says 172.21.15.81:51708) 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 -- 172.21.15.81:0/1306456507 learned_addr learned my addr 172.21.15.81:0/1306456507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de6a00640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b6c770 0x55ace4b6e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7e00640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b9c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 -- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b6c770 msgr2=0x55ace4b6e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b6c770 0x55ace4b6e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 -- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 msgr2=0x55ace4b9c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b9c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 -- 172.21.15.81:0/1306456507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace4b70830 con 0x55ace4b35b80 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7e00640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8de7400640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009fd0 tx=0x7f8dd801f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa778d3ff3d9508c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.710+0000 7f8dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8039440 con 0x55ace4b35b80 2024-09-11T00:58:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8dd8030400 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd801f8b0 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8dd8030600 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 10 client.5469 fetch_fsmap learned FSMap version 9 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ace4b60670 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dd801f8b0 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8dd8037020 con 0x55ace4b35b80 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 10 client.5469 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 10 client.5469 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 20 client.5469 populate_metadata read hostname 'smithi081' 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b5fd50 0x55ace4b9c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 4 client.5469 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "780d0044", "release": true, "await": true}] 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.711+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "780d0044", "release": true, "await": true}) -- 0x55ace4aa7d70 con 0x55ace4b5fd50 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.712+0000 7f8de6a00640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b5fd50 0x55ace4b9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.712+0000 7f8de6a00640 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b5fd50 0x55ace4b9c680 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da3f447af6582ce9 server_cookie=abad84916b0183d9 in_seq=0 out_seq=0 2024-09-11T00:58:47.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.712+0000 7f8dc7e00640 10 client.5469 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8dc7e00640 1 -- 172.21.15.81:0/1306456507 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ace4aa7d70 con 0x55ace4b5fd50 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8dc7e00640 10 client.5469 handle_command_reply: tid=0 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 client.5469 shutdown 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 msgr2=0x55ace4bfcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009fd0 tx=0x7f8dd801f4e0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 shutdown_connections 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55ace4b5fd50 0x55ace4b9c680 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ace4b77810 0x55ace4b9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ace4b6c770 0x55ace4b6e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 --2- 172.21.15.81:0/1306456507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ace4b35b80 0x55ace4bfcb30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 >> 172.21.15.81:0/1306456507 conn(0x55ace4b32910 msgr2=0x55ace4b30d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8dc7e00640 0 client.5469 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 shutdown_connections 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.731+0000 7f8df1258740 1 -- 172.21.15.81:0/1306456507 wait complete. 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8df1258740 20 client.5469 trim_cache size 0 max 16384 2024-09-11T00:58:47.735 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 48, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "780d0044": { 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 48, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T00:58:47.736 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 142.8, 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T00:58:47.737 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T00:58:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 msgr2=0x7f8dc807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 0x7f8dc807a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd8009680 comp rx=0 tx=0).stop 2024-09-11T00:58:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 msgr2=0x7f8de80aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006010 tx=0x7f8de0003890 comp rx=0 tx=0).stop 2024-09-11T00:58:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 shutdown_connections 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8dc8077f70 0x7f8dc807a430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de80c7360 0x7f8de80aef80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8de80725a0 0x7f8de80c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 --2- 172.21.15.81:0/2660944469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8de806f760 0x7f8de80b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 >> 172.21.15.81:0/2660944469 conn(0x7f8de806ff90 msgr2=0x7f8de80cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 shutdown_connections 2024-09-11T00:58:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T00:58:47.732+0000 7f8dee200640 1 -- 172.21.15.81:0/2660944469 wait complete. 2024-09-11T00:58:47.752 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '780d0044', total seconds elapsed: 23.4 2024-09-11T00:58:49.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:58:49.675 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:59:19.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:59:19.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:59:49.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:59:49.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:00:12.253 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.8 2024-09-11T01:00:12.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:00:12.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 -- 172.21.15.81:0/668391913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc0c8680 msgr2=0x7f98cc0c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 --2- 172.21.15.81:0/668391913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc0c8680 0x7f98cc0c7ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98cc074fb0 tx=0x7f98c402a920 comp rx=0 tx=0).stop 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 -- 172.21.15.81:0/668391913 shutdown_connections 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 --2- 172.21.15.81:0/668391913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc0c8680 0x7f98cc0c7ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 --2- 172.21.15.81:0/668391913 >> v2:172.21.15.167:3300/0 conn(0x7f98cc074860 0x7f98cc0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 -- 172.21.15.81:0/668391913 >> 172.21.15.81:0/668391913 conn(0x7f98cc0700f0 msgr2=0x7f98cc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 -- 172.21.15.81:0/668391913 shutdown_connections 2024-09-11T01:00:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.439+0000 7f98d3a00640 1 -- 172.21.15.81:0/668391913 wait complete. 2024-09-11T01:00:12.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.441+0000 7f98d3a00640 1 Processor -- start 2024-09-11T01:00:12.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.441+0000 7f98d3a00640 1 -- start start 2024-09-11T01:00:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc152610 0x7f98cc1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98cc152de0 0x7f98cc14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc070cf0 con 0x7f98cc074860 2024-09-11T01:00:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc15c140 con 0x7f98cc152de0 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d3a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f98cc0c16a0 con 0x7f98cc152610 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42882/0 (socket says 172.21.15.81:42882) 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 -- 172.21.15.81:0/2617495663 learned_addr learned my addr 172.21.15.81:0/2617495663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98cbe00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc152610 0x7f98cc1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98cc152de0 0x7f98cc14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 -- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc152610 msgr2=0x7f98cc1f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc152610 0x7f98cc1f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 -- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98cc152de0 msgr2=0x7f98cc14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98cc152de0 0x7f98cc14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.442+0000 7f98d1000640 1 -- 172.21.15.81:0/2617495663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc073d20 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98d1000640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f98c000c4c0 tx=0x7f98c000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0016020 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98c0012940 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0012d90 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc074000 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.443+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc0726f0 con 0x7f98cc074860 2024-09-11T01:00:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.444+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc0728f0 con 0x7f98cc074860 2024-09-11T01:00:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.446+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f98c001b400 con 0x7f98cc074860 2024-09-11T01:00:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.447+0000 7f98c8c00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 0x7f98ac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.447+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f98c009a310 con 0x7f98cc074860 2024-09-11T01:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.448+0000 7f98cbe00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 0x7f98ac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.449+0000 7f98cbe00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 0x7f98ac07a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98b80095f0 tx=0x7f98b8005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.452+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f98cc0728f0 con 0x7f98cc074860 2024-09-11T01:00:12.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.718+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98cc1529f0 con 0x7f98cc074860 2024-09-11T01:00:12.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.718+0000 7f98c8c00640 1 -- 172.21.15.81:0/2617495663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f98c0020020 con 0x7f98cc074860 2024-09-11T01:00:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:00:12.720 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:00:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 msgr2=0x7f98ac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 0x7f98ac07a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98b80095f0 tx=0x7f98b8005f90 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 msgr2=0x7f98cc155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f98c000c4c0 tx=0x7f98c000c980 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 shutdown_connections 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f98ac077fa0 0x7f98ac07a460 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98cc152de0 0x7f98cc14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98cc152610 0x7f98cc1f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 --2- 172.21.15.81:0/2617495663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98cc074860 0x7f98cc155a70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.721+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 >> 172.21.15.81:0/2617495663 conn(0x7f98cc0700f0 msgr2=0x7f98cc150590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.722+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 shutdown_connections 2024-09-11T01:00:12.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.722+0000 7f98d3a00640 1 -- 172.21.15.81:0/2617495663 wait complete. 2024-09-11T01:00:12.742 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 154.8 --await-for 45.0' 2024-09-11T01:00:12.742 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 154.8 --await-for 45.0 2024-09-11T01:00:12.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 -- 172.21.15.81:0/2611753530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 msgr2=0x7f37ac0c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2611753530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac0c35b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f37ac071b90 tx=0x7f379802a680 comp rx=0 tx=0).stop 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 -- 172.21.15.81:0/2611753530 shutdown_connections 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2611753530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac0c35b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2611753530 >> v2:172.21.15.167:3300/0 conn(0x7f37ac157eb0 0x7f37ac0cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 -- 172.21.15.81:0/2611753530 >> 172.21.15.81:0/2611753530 conn(0x7f37ac0ca9b0 msgr2=0x7f37ac0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 -- 172.21.15.81:0/2611753530 shutdown_connections 2024-09-11T01:00:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.932+0000 7f37b2a00640 1 -- 172.21.15.81:0/2611753530 wait complete. 2024-09-11T01:00:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.934+0000 7f37b2a00640 1 Processor -- start 2024-09-11T01:00:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.934+0000 7f37b2a00640 1 -- start start 2024-09-11T01:00:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 0x7f37ac06df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37ac157eb0 0x7f37ac158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac0c7860 con 0x7f37ac0c8060 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac0c7580 con 0x7f37ac070c70 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37ac0c7b40 con 0x7f37ac157eb0 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42910/0 (socket says 172.21.15.81:42910) 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b0c00640 1 -- 172.21.15.81:0/2567500426 learned_addr learned my addr 172.21.15.81:0/2567500426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b1600640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 0x7f37ac06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.935+0000 7f37b2000640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37ac157eb0 0x7f37ac158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 -- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37ac157eb0 msgr2=0x7f37ac158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37ac157eb0 0x7f37ac158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 -- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 msgr2=0x7f37ac06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 0x7f37ac06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 -- 172.21.15.81:0/2567500426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac1f5000 con 0x7f37ac0c8060 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b1600640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 0x7f37ac06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b0c00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3798000c00 tx=0x7f3798003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37a9600640 1 -- 172.21.15.81:0/2567500426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379803f070 con 0x7f37ac0c8060 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37a9600640 1 -- 172.21.15.81:0/2567500426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37980047a0 con 0x7f37ac0c8060 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37a9600640 1 -- 172.21.15.81:0/2567500426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798035030 con 0x7f37ac0c8060 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac06f4b0 con 0x7f37ac0c8060 2024-09-11T01:00:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.936+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac15ae30 con 0x7f37ac0c8060 2024-09-11T01:00:12.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.940+0000 7f37a9600640 1 -- 172.21.15.81:0/2567500426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3798004bb0 con 0x7f37ac0c8060 2024-09-11T01:00:12.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.941+0000 7f37a9600640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 0x7f378c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.941+0000 7f37b708c740 1 Processor -- start 2024-09-11T01:00:12.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.941+0000 7f37a9600640 1 -- 172.21.15.81:0/2567500426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f37980bb090 con 0x7f37ac0c8060 2024-09-11T01:00:12.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.941+0000 7f37b708c740 1 -- start start 2024-09-11T01:00:12.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.941+0000 7f37b1600640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 0x7f378c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b1600640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 0x7f378c07a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009f20 tx=0x7f37a0005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da326d7c0 0x562da326dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32b1ba0 0x562da32a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562da31e6260 con 0x562da32740c0 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562da31d5690 con 0x562da32b1ba0 2024-09-11T01:00:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x562da31d94a0 con 0x562da326d7c0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.942+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42922/0 (socket says 172.21.15.81:42922) 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 -- 172.21.15.81:0/108239863 learned_addr learned my addr 172.21.15.81:0/108239863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b1600640 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da326d7c0 0x562da326dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b2000640 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32b1ba0 0x562da32a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 -- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da326d7c0 msgr2=0x562da326dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da326d7c0 0x562da326dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 -- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32b1ba0 msgr2=0x562da32a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32b1ba0 0x562da32a8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 -- 172.21.15.81:0/108239863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da2fafd80 con 0x562da32740c0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f37b0c00640 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37980b9250 tx=0x7f379808c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864937ac48a97101 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f379dc00640 1 -- 172.21.15.81:0/108239863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798049040 con 0x562da32740c0 2024-09-11T01:00:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.943+0000 7f379dc00640 1 -- 172.21.15.81:0/108239863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3798083260 con 0x562da32740c0 2024-09-11T01:00:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f379dc00640 1 -- 172.21.15.81:0/108239863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798087c90 con 0x562da32740c0 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 -- 172.21.15.81:0/108239863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 msgr2=0x562da3274800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37980b9250 tx=0x7f379808c140 comp rx=0 tx=0).stop 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 -- 172.21.15.81:0/108239863 shutdown_connections 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32b1ba0 0x562da32a8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da3274800 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 --2- 172.21.15.81:0/108239863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da326d7c0 0x562da326dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 -- 172.21.15.81:0/108239863 >> 172.21.15.81:0/108239863 conn(0x562da326f520 msgr2=0x562da3272df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 -- 172.21.15.81:0/108239863 shutdown_connections 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.944+0000 7f37b708c740 1 -- 172.21.15.81:0/108239863 wait complete. 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.945+0000 7f37b708c740 1 -- start start 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.945+0000 7f37b708c740 1 Processor -- start 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da329c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 0x562da329b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562da2f45cc0 con 0x562da32b1ba0 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562da317ae60 con 0x562da32740c0 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x562da31e6260 con 0x562da32a81b0 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.946+0000 7f37b708c740 10 client.0 _ll_register_callbacks cb 0x562da3181030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42936/0 (socket says 172.21.15.81:42936) 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da329c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b0c00640 1 -- 172.21.15.81:0/3771009976 learned_addr learned my addr 172.21.15.81:0/3771009976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 0x562da329b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 -- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 msgr2=0x562da329b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 0x562da329b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 -- 172.21.15.81:0/3771009976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 msgr2=0x562da329aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 -- 172.21.15.81:0/3771009976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da3010510 con 0x562da32740c0 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b2000640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 0x562da329b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b0c00640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.947+0000 7f37b1600640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da329c400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37a0011ca0 tx=0x7f37a0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0c9c8c0dc4abcf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f3792000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:00:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a000fe10 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f37a0028440 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3798083260 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f37a0030050 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f37b708c740 10 client.5392 fetch_fsmap learned FSMap version 9 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562da2f14c20 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.948+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3798083260 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f37a0033020 con 0x562da32740c0 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 10 client.5392 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 10 client.5392 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 20 client.5392 populate_metadata read hostname 'smithi081' 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da329b680 0x562da32a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 4 client.5392 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:00:12.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562da31e81b0 con 0x562da329b680 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.949+0000 7f37b0c00640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da329b680 0x562da32a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.950+0000 7f3792000640 10 client.5392 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.950+0000 7f37b0c00640 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da329b680 0x562da32a5d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6023293cc8458bd8 server_cookie=f3c0d20b213c2458 in_seq=0 out_seq=0 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f3792000640 1 -- 172.21.15.81:0/3771009976 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562da31e81b0 con 0x562da329b680 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f3792000640 10 client.5392 handle_command_reply: tid=0 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 client.5392 shutdown 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 msgr2=0x562da329c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da329c400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37a0011ca0 tx=0x7f37a0004730 comp rx=0 tx=0).stop 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 shutdown_connections 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da329b680 0x562da32a5d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a81b0 0x562da329b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da329aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 --2- 172.21.15.81:0/3771009976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da329c400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f3792000640 0 client.5392 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 >> 172.21.15.81:0/3771009976 conn(0x562da326d7c0 msgr2=0x562da32a1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 shutdown_connections 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 1 -- 172.21.15.81:0/3771009976 wait complete. 2024-09-11T01:00:12.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.951+0000 7f37b708c740 20 client.5392 trim_cache size 0 max 16384 2024-09-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.971+0000 7f37b708c740 1 Processor -- start 2024-09-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.971+0000 7f37b708c740 1 -- start start 2024-09-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32b1ba0 0x562da32a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32a3cd0 0x562da326e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1ff2e0 con 0x562da32740c0 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1fe1c0 con 0x562da32a3cd0 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37ac1f14e0 con 0x562da32b1ba0 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42938/0 (socket says 172.21.15.81:42938) 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b1600640 1 -- 172.21.15.81:0/2920816767 learned_addr learned my addr 172.21.15.81:0/2920816767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b0c00640 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32b1ba0 0x562da32a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.972+0000 7f37b2000640 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32a3cd0 0x562da326e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 -- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32b1ba0 msgr2=0x562da32a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32b1ba0 0x562da32a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 -- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32a3cd0 msgr2=0x562da326e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32a3cd0 0x562da326e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 -- 172.21.15.81:0/2920816767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da326fc50 con 0x562da32740c0 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f37b1600640 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f37a0003f00 tx=0x7f37a0003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286367840ab524e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f379d200640 1 -- 172.21.15.81:0/2920816767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a002d070 con 0x562da32740c0 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f379d200640 1 -- 172.21.15.81:0/2920816767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37a0028440 con 0x562da32740c0 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.973+0000 7f379d200640 1 -- 172.21.15.81:0/2920816767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a000fe10 con 0x562da32740c0 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 -- 172.21.15.81:0/2920816767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 msgr2=0x562da32a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f37a0003f00 tx=0x7f37a0003f30 comp rx=0 tx=0).stop 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 -- 172.21.15.81:0/2920816767 shutdown_connections 2024-09-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32a3cd0 0x562da326e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32b1ba0 0x562da32a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 --2- 172.21.15.81:0/2920816767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32740c0 0x562da32a7610 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 -- 172.21.15.81:0/2920816767 >> 172.21.15.81:0/2920816767 conn(0x562da326d7c0 msgr2=0x562da32a4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 -- 172.21.15.81:0/2920816767 shutdown_connections 2024-09-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.974+0000 7f37b708c740 1 -- 172.21.15.81:0/2920816767 wait complete. 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.975+0000 7f37b708c740 1 -- start start 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.975+0000 7f37b708c740 1 Processor -- start 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.976+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da32b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 0x562da332e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1fcf40 con 0x562da32b1ba0 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac1fdb10 con 0x562da32740c0 2024-09-11T01:00:12.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37ac1fd4c0 con 0x562da32a3cd0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b708c740 10 client.0 _ll_register_callbacks cb 0x7f37a0004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42948/0 (socket says 172.21.15.81:42948) 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 -- 172.21.15.81:0/1697542127 learned_addr learned my addr 172.21.15.81:0/1697542127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b1600640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da32b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b0c00640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 0x562da332e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 -- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 msgr2=0x562da332e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 0x562da332e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 -- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 msgr2=0x562da32b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da32b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b2000640 1 -- 172.21.15.81:0/1697542127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da332eb90 con 0x562da32b1ba0 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.977+0000 7f37b0c00640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 0x562da332e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:00:12.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f37b2000640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37a4016e70 tx=0x7f37a4015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d2177e5ac24831 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:12.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f3792000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:00:12.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4003970 con 0x562da32b1ba0 2024-09-11T01:00:12.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f37a4010040 con 0x562da32b1ba0 2024-09-11T01:00:12.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37a0028440 con 0x562da32b1ba0 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f37a4028050 con 0x562da32b1ba0 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f37b708c740 10 client.5490 fetch_fsmap learned FSMap version 9 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.978+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562da32a1000 con 0x562da32b1ba0 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37a0028440 con 0x562da32b1ba0 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f37a402b020 con 0x562da32b1ba0 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 10 client.5490 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 10 client.5490 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:00:12.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 20 client.5490 populate_metadata read hostname 'smithi081' 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da32b2970 0x562da32af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 4 client.5490 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.8, "await_for": 45.0}] 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.8, "await_for": 45.0}) -- 0x562da31e3c60 con 0x562da32b2970 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.979+0000 7f37b1600640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da32b2970 0x562da32af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.980+0000 7f37b1600640 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da32b2970 0x562da32af940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4679e02cbd24e2c server_cookie=fd8f0a577da79a04 in_seq=0 out_seq=0 2024-09-11T01:00:12.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:12.980+0000 7f3792000640 10 client.5490 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f3792000640 1 -- 172.21.15.81:0/1697542127 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562da31e3c60 con 0x562da32b2970 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f3792000640 10 client.5490 handle_command_reply: tid=0 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 client.5490 shutdown 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 msgr2=0x562da3297980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37a4016e70 tx=0x7f37a4015780 comp rx=0 tx=0).stop 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 shutdown_connections 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x562da32b2970 0x562da32af940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562da32b1ba0 0x562da3297980 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562da32a3cd0 0x562da332e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 --2- 172.21.15.81:0/1697542127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562da32740c0 0x562da32b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f3792000640 0 client.5490 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.076+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 >> 172.21.15.81:0/1697542127 conn(0x562da326d7c0 msgr2=0x562da32a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 shutdown_connections 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b708c740 1 -- 172.21.15.81:0/1697542127 wait complete. 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b708c740 20 client.5490 trim_cache size 0 max 16384 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:00:13.079 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 50, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "7f9e00c7": { 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 50, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 154.8, 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:00:13.080 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:13.081 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 msgr2=0x7f378c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 0x7f378c07a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009f20 tx=0x7f37a0005f90 comp rx=0 tx=0).stop 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 msgr2=0x7f37ac06fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3798000c00 tx=0x7f3798003820 comp rx=0 tx=0).stop 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 shutdown_connections 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f378c077f70 0x7f378c07a430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37ac157eb0 0x7f37ac158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37ac0c8060 0x7f37ac06fc50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.077+0000 7f37b2a00640 1 --2- 172.21.15.81:0/2567500426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37ac070c70 0x7f37ac06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:13.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.078+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 >> 172.21.15.81:0/2567500426 conn(0x7f37ac0ca9b0 msgr2=0x7f37ac0c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:13.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.078+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 shutdown_connections 2024-09-11T01:00:13.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:13.078+0000 7f37b2a00640 1 -- 172.21.15.81:0/2567500426 wait complete. 2024-09-11T01:00:13.094 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7f9e00c7', quiesce took 0.8 seconds. Will release after: 34.0 2024-09-11T01:00:20.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:00:20.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:00:47.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 -- 172.21.15.81:0/4098591804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 msgr2=0x7f50781587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 --2- 172.21.15.81:0/4098591804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50781587d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5070005fd0 tx=0x7f507002ab20 comp rx=0 tx=0).stop 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 -- 172.21.15.81:0/4098591804 shutdown_connections 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 --2- 172.21.15.81:0/4098591804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50781587d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 --2- 172.21.15.81:0/4098591804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781522d0 0x7f50780707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 -- 172.21.15.81:0/4098591804 >> 172.21.15.81:0/4098591804 conn(0x7f50780688e0 msgr2=0x7f5078068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 -- 172.21.15.81:0/4098591804 shutdown_connections 2024-09-11T01:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.260+0000 7f507d200640 1 -- 172.21.15.81:0/4098591804 wait complete. 2024-09-11T01:00:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.261+0000 7f507d200640 1 Processor -- start 2024-09-11T01:00:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.261+0000 7f507d200640 1 -- start start 2024-09-11T01:00:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50781522d0 0x7f5078154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781526b0 0x7f507806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f507815b790 con 0x7f50780b3d10 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f507815c690 con 0x7f50781522d0 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.262+0000 7f507d200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f50780ce6f0 con 0x7f50781526b0 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48880/0 (socket says 172.21.15.81:48880) 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 -- 172.21.15.81:0/586827068 learned_addr learned my addr 172.21.15.81:0/586827068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077e00640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781526b0 0x7f507806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5076a00640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50781522d0 0x7f5078154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 -- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781526b0 msgr2=0x7f507806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781526b0 0x7f507806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 -- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50781522d0 msgr2=0x7f5078154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50781522d0 0x7f5078154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 -- 172.21.15.81:0/586827068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078154640 con 0x7f50780b3d10 2024-09-11T01:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.263+0000 7f5077400640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f506800d770 tx=0x7f506800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.264+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068017070 con 0x7f50780b3d10 2024-09-11T01:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.264+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5068009d20 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.264+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50781580b0 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.264+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068005280 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.264+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507815b420 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.265+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5078151e10 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.266+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5068005420 con 0x7f50780b3d10 2024-09-11T01:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.267+0000 7f506f400640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 0x7f505807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.267+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f506809a300 con 0x7f50780b3d10 2024-09-11T01:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.267+0000 7f5076a00640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 0x7f505807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.268+0000 7f5076a00640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 0x7f505807a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f507806fc80 tx=0x7f5064009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.271+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f50680623a0 con 0x7f50780b3d10 2024-09-11T01:00:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.489+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f507814f520 con 0x7f50780b3d10 2024-09-11T01:00:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.490+0000 7f506f400640 1 -- 172.21.15.81:0/586827068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f506806b110 con 0x7f50780b3d10 2024-09-11T01:00:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:00:47.492 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:00:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 msgr2=0x7f505807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 0x7f505807a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f507806fc80 tx=0x7f5064009040 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 msgr2=0x7f50780cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f506800d770 tx=0x7f506800dc30 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 shutdown_connections 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5058077f70 0x7f505807a430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50781526b0 0x7f507806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50781522d0 0x7f5078154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 --2- 172.21.15.81:0/586827068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50780b3d10 0x7f50780cd5f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 >> 172.21.15.81:0/586827068 conn(0x7f50780688e0 msgr2=0x7f5078070540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 shutdown_connections 2024-09-11T01:00:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.492+0000 7f507d200640 1 -- 172.21.15.81:0/586827068 wait complete. 2024-09-11T01:00:47.511 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 7f9e00c7 --release --await' 2024-09-11T01:00:47.512 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 7f9e00c7 --release --await 2024-09-11T01:00:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 -- 172.21.15.81:0/4074986049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406f760 msgr2=0x7f24d4070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 --2- 172.21.15.81:0/4074986049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406f760 0x7f24d4070c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009830 tx=0x7f24c402a510 comp rx=0 tx=0).stop 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 -- 172.21.15.81:0/4074986049 shutdown_connections 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 --2- 172.21.15.81:0/4074986049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40725a0 0x7f24d40729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 --2- 172.21.15.81:0/4074986049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406f760 0x7f24d4070c40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.674+0000 7f24da800640 1 -- 172.21.15.81:0/4074986049 >> 172.21.15.81:0/4074986049 conn(0x7f24d406ff90 msgr2=0x7f24d40703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.675+0000 7f24da800640 1 -- 172.21.15.81:0/4074986049 shutdown_connections 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.675+0000 7f24da800640 1 -- 172.21.15.81:0/4074986049 wait complete. 2024-09-11T01:00:47.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.676+0000 7f24da800640 1 Processor -- start 2024-09-11T01:00:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.676+0000 7f24da800640 1 -- start start 2024-09-11T01:00:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d406f760 0x7f24d41deb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c7360 0x7f24d414e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4074db0 con 0x7f24d40725a0 2024-09-11T01:00:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24d40c6bf0 con 0x7f24d406f760 2024-09-11T01:00:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24da800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40c6e40 con 0x7f24d40c7360 2024-09-11T01:00:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48884/0 (socket says 172.21.15.81:48884) 2024-09-11T01:00:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.677+0000 7f24d2a00640 1 -- 172.21.15.81:0/473646264 learned_addr learned my addr 172.21.15.81:0/473646264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d3e00640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c7360 0x7f24d414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d3400640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d406f760 0x7f24d41deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 -- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c7360 msgr2=0x7f24d414e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c7360 0x7f24d414e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 -- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d406f760 msgr2=0x7f24d41deb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d406f760 0x7f24d41deb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 -- 172.21.15.81:0/473646264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d414e7f0 con 0x7f24d40725a0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24d2a00640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c730 tx=0x7f24c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24cb400640 1 -- 172.21.15.81:0/473646264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0016020 con 0x7f24d40725a0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24cb400640 1 -- 172.21.15.81:0/473646264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24c000a8d0 con 0x7f24d40725a0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d41de870 con 0x7f24d40725a0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24cb400640 1 -- 172.21.15.81:0/473646264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c000ad20 con 0x7f24d40725a0 2024-09-11T01:00:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.678+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d414ea90 con 0x7f24d40725a0 2024-09-11T01:00:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.681+0000 7f24cb400640 1 -- 172.21.15.81:0/473646264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f24c001b400 con 0x7f24d40725a0 2024-09-11T01:00:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.682+0000 7f24cb400640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 0x7f24b407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.682+0000 7f24cb400640 1 -- 172.21.15.81:0/473646264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f24c009a210 con 0x7f24d40725a0 2024-09-11T01:00:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.682+0000 7f24dd835740 1 Processor -- start 2024-09-11T01:00:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.682+0000 7f24d3400640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 0x7f24b407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.682+0000 7f24dd835740 1 -- start start 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d3400640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 0x7f24b407a460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24c4034000 tx=0x7f24c4004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 0x55df64aa5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55df649e3370 con 0x55df64a6e190 2024-09-11T01:00:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55df649d27a0 con 0x55df64a6e570 2024-09-11T01:00:47.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55df649d65b0 con 0x55df64aa5830 2024-09-11T01:00:47.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48890/0 (socket says 172.21.15.81:48890) 2024-09-11T01:00:47.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d3400640 1 -- 172.21.15.81:0/4244458879 learned_addr learned my addr 172.21.15.81:0/4244458879 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d2a00640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.683+0000 7f24d3e00640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 0x55df64aa5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 -- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 msgr2=0x55df64aa5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 0x55df64aa5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 -- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 msgr2=0x55df64a6ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 -- 172.21.15.81:0/4244458879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6496b010 con 0x55df64a6e190 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3e00640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 0x55df64aa5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:00:47.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24d3400640 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009920 tx=0x7f24c403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7566bce184d7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24bfe00640 1 -- 172.21.15.81:0/4244458879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4003d40 con 0x55df64a6e190 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24bfe00640 1 -- 172.21.15.81:0/4244458879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24c403c420 con 0x55df64a6e190 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.684+0000 7f24bfe00640 1 -- 172.21.15.81:0/4244458879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c403c830 con 0x55df64a6e190 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 -- 172.21.15.81:0/4244458879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 msgr2=0x55df64a6fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009920 tx=0x7f24c403e070 comp rx=0 tx=0).stop 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 -- 172.21.15.81:0/4244458879 shutdown_connections 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa5830 0x55df64aa5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 --2- 172.21.15.81:0/4244458879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64a6e190 0x55df64a6fa80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 -- 172.21.15.81:0/4244458879 >> 172.21.15.81:0/4244458879 conn(0x55df64a6c370 msgr2=0x55df64a6d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 -- 172.21.15.81:0/4244458879 shutdown_connections 2024-09-11T01:00:47.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.685+0000 7f24dd835740 1 -- 172.21.15.81:0/4244458879 wait complete. 2024-09-11T01:00:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.686+0000 7f24dd835740 1 -- start start 2024-09-11T01:00:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.686+0000 7f24dd835740 1 Processor -- start 2024-09-11T01:00:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a9ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55df64979f70 con 0x55df64aa5830 2024-09-11T01:00:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55df64978090 con 0x55df64aa2220 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55df64a9b560 con 0x55df64a6e570 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24dd835740 10 client.0 _ll_register_callbacks cb 0x55df646e1110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48896/0 (socket says 172.21.15.81:48896) 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 -- 172.21.15.81:0/3218446644 learned_addr learned my addr 172.21.15.81:0/3218446644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 -- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 msgr2=0x55df64a9ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a9ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 -- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 msgr2=0x55df64a9fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.687+0000 7f24d2a00640 1 -- 172.21.15.81:0/3218446644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df64734ea0 con 0x55df64aa5830 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24d2a00640 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24c005f500 tx=0x7f24c0061be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c760212852c46a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00616f0 con 0x55df64aa5830 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24c403c420 con 0x55df64aa5830 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f24c0086e50 con 0x55df64aa5830 2024-09-11T01:00:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f24c0001d10 con 0x55df64aa5830 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24dd835740 10 client.5511 fetch_fsmap learned FSMap version 9 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55df647add30 con 0x55df64aa5830 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24c403c420 con 0x55df64aa5830 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f24c005dbe0 con 0x55df64aa5830 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24dd835740 10 client.5511 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.688+0000 7f24dd835740 10 client.5511 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24dd835740 20 client.5511 populate_metadata read hostname 'smithi081' 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64aa0830 0x55df64a97e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24dd835740 4 client.5511 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df649e52c0 con 0x55df64aa0830 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24d3400640 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64aa0830 0x55df64a97e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24d3400640 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64aa0830 0x55df64a97e30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de45e106025f22c server_cookie=f9ef37faa8cf7210 in_seq=0 out_seq=0 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.689+0000 7f24bcc00640 10 client.5511 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.690+0000 7f24bcc00640 1 -- 172.21.15.81:0/3218446644 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df649e52c0 con 0x55df64aa0830 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.690+0000 7f24bcc00640 10 client.5511 handle_command_reply: tid=0 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.690+0000 7f24dd835740 1 client.5511 shutdown 2024-09-11T01:00:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 msgr2=0x55df64a711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f24c005f500 tx=0x7f24c0061be0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 shutdown_connections 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64aa0830 0x55df64a97e30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a711c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24bcc00640 0 client.5511 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 --2- 172.21.15.81:0/3218446644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a9ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 >> 172.21.15.81:0/3218446644 conn(0x55df64a6e190 msgr2=0x55df64a69320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 shutdown_connections 2024-09-11T01:00:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 1 -- 172.21.15.81:0/3218446644 wait complete. 2024-09-11T01:00:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.691+0000 7f24dd835740 20 client.5511 trim_cache size 0 max 16384 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.709+0000 7f24dd835740 1 Processor -- start 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.709+0000 7f24dd835740 1 -- start start 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa2220 0x55df64a70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24d41ff400 con 0x55df64aa5830 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24d41fe2e0 con 0x55df64a6e570 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24d41f4c00 con 0x55df64aa2220 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48908/0 (socket says 172.21.15.81:48908) 2024-09-11T01:00:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 -- 172.21.15.81:0/301350886 learned_addr learned my addr 172.21.15.81:0/301350886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3400640 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d2a00640 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa2220 0x55df64a70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 -- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa2220 msgr2=0x55df64a70230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa2220 0x55df64a70230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 -- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 msgr2=0x55df64a6fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.710+0000 7f24d3e00640 1 -- 172.21.15.81:0/301350886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df64a9a170 con 0x55df64aa5830 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24d3e00640 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f24cc008c40 tx=0x7f24cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf7c8e9817146fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24bf400640 1 -- 172.21.15.81:0/301350886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc004d20 con 0x55df64aa5830 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24bf400640 1 -- 172.21.15.81:0/301350886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24cc015070 con 0x55df64aa5830 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24bf400640 1 -- 172.21.15.81:0/301350886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc005280 con 0x55df64aa5830 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 -- 172.21.15.81:0/301350886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 msgr2=0x55df64ad4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f24cc008c40 tx=0x7f24cc0107a0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 -- 172.21.15.81:0/301350886 shutdown_connections 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64ad4440 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64aa2220 0x55df64a70230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 --2- 172.21.15.81:0/301350886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64a6e570 0x55df64a6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.711+0000 7f24dd835740 1 -- 172.21.15.81:0/301350886 >> 172.21.15.81:0/301350886 conn(0x55df64a6e190 msgr2=0x55df64a6d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.712+0000 7f24dd835740 1 -- 172.21.15.81:0/301350886 shutdown_connections 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.712+0000 7f24dd835740 1 -- 172.21.15.81:0/301350886 wait complete. 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.712+0000 7f24dd835740 1 -- start start 2024-09-11T01:00:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.712+0000 7f24dd835740 1 Processor -- start 2024-09-11T01:00:47.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a8e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24d41fd090 con 0x55df64aa5830 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24d41fdc10 con 0x55df64aa2220 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24d41fd620 con 0x55df64a6e570 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24dd835740 10 client.0 _ll_register_callbacks cb 0x7f24c0007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48916/0 (socket says 172.21.15.81:48916) 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.713+0000 7f24d3e00640 1 -- 172.21.15.81:0/3766118332 learned_addr learned my addr 172.21.15.81:0/3766118332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3400640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a8e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d2a00640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 -- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 msgr2=0x55df64a8e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a8e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 -- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 msgr2=0x55df64a9c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 -- 172.21.15.81:0/3766118332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df64a9c740 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d2a00640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24d3e00640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000f80 tx=0x7f24cc008920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d9ec782901c784 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0054f0 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f24cc026e50 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.714+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24cc015070 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f24cc005690 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 10 client.5517 fetch_fsmap learned FSMap version 9 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55df64a6ca10 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24cc015070 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f24cc005830 con 0x55df64aa5830 2024-09-11T01:00:47.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 10 client.5517 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 10 client.5517 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 20 client.5517 populate_metadata read hostname 'smithi081' 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64a950e0 0x55df64a9bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 4 client.5517 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7f9e00c7", "release": true, "await": true}] 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7f9e00c7", "release": true, "await": true}) -- 0x55df649e0d70 con 0x55df64a950e0 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.715+0000 7f24d3400640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64a950e0 0x55df64a9bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.716+0000 7f24d3400640 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64a950e0 0x55df64a9bc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f4aa49abdf8d2a server_cookie=8bc37562eb93f286 in_seq=0 out_seq=0 2024-09-11T01:00:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.716+0000 7f24bcc00640 10 client.5517 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24bcc00640 1 -- 172.21.15.81:0/3766118332 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55df649e0d70 con 0x55df64a950e0 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24bcc00640 10 client.5517 handle_command_reply: tid=0 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 client.5517 shutdown 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 msgr2=0x55df64a9b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000f80 tx=0x7f24cc008920 comp rx=0 tx=0).stop 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 shutdown_connections 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55df64a950e0 0x55df64a9bc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df64aa5830 0x55df64a9b6f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df64aa2220 0x55df64a9c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 --2- 172.21.15.81:0/3766118332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df64a6e570 0x55df64a8e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 >> 172.21.15.81:0/3766118332 conn(0x55df64a6e190 msgr2=0x55df64aa6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24bcc00640 0 client.5517 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 shutdown_connections 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 1 -- 172.21.15.81:0/3766118332 wait complete. 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24dd835740 20 client.5517 trim_cache size 0 max 16384 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 52, 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:00:47.739 INFO:teuthology.orchestra.run.smithi081.stdout: "7f9e00c7": { 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 52, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 154.8, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:00:47.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:00:47.741 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 msgr2=0x7f24b407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 0x7f24b407a460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24c4034000 tx=0x7f24c4004730 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 msgr2=0x7f24d41f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c730 tx=0x7f24c000cbf0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 shutdown_connections 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f24b4077fa0 0x7f24b407a460 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c7360 0x7f24d414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d40725a0 0x7f24d41f16f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 --2- 172.21.15.81:0/473646264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d406f760 0x7f24d41deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 >> 172.21.15.81:0/473646264 conn(0x7f24d406ff90 msgr2=0x7f24d40caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 shutdown_connections 2024-09-11T01:00:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:00:47.736+0000 7f24da800640 1 -- 172.21.15.81:0/473646264 wait complete. 2024-09-11T01:00:47.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7f9e00c7', total seconds elapsed: 35.5 2024-09-11T01:00:51.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:00:51.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:01:21.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:01:21.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:01:51.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:01:51.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:01:52.385 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:01:52.385 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.0 2024-09-11T01:01:52.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:01:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 -- 172.21.15.81:0/3016545976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c06daf0 msgr2=0x7f467c06dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 --2- 172.21.15.81:0/3016545976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c06daf0 0x7f467c06dfa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4674005fd0 tx=0x7f467402a940 comp rx=0 tx=0).stop 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 -- 172.21.15.81:0/3016545976 shutdown_connections 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 --2- 172.21.15.81:0/3016545976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c06daf0 0x7f467c06dfa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 --2- 172.21.15.81:0/3016545976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 0x7f467c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 -- 172.21.15.81:0/3016545976 >> 172.21.15.81:0/3016545976 conn(0x7f467c0cdf20 msgr2=0x7f467c0ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 -- 172.21.15.81:0/3016545976 shutdown_connections 2024-09-11T01:01:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.556+0000 7f4683000640 1 -- 172.21.15.81:0/3016545976 wait complete. 2024-09-11T01:01:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.558+0000 7f4683000640 1 Processor -- start 2024-09-11T01:01:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.558+0000 7f4683000640 1 -- start start 2024-09-11T01:01:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f467c06daf0 0x7f467c1e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 0x7f467c14bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f467c071d60 con 0x7f467c070a70 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f467c072be0 con 0x7f467c06daf0 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4683000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f467c154a60 con 0x7f467c154680 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4681200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4681200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55014/0 (socket says 172.21.15.81:55014) 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4681200640 1 -- 172.21.15.81:0/3072931114 learned_addr learned my addr 172.21.15.81:0/3072931114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4682600640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 0x7f467c14bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.559+0000 7f4681c00640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f467c06daf0 0x7f467c1e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 -- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 msgr2=0x7f467c14bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 0x7f467c14bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 -- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f467c06daf0 msgr2=0x7f467c1e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f467c06daf0 0x7f467c1e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 -- 172.21.15.81:0/3072931114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c1f10a0 con 0x7f467c070a70 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4681200640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f466800c730 tx=0x7f466800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668017070 con 0x7f467c070a70 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4668005160 con 0x7f467c070a70 2024-09-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c1f3b00 con 0x7f467c070a70 2024-09-11T01:01:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466800a640 con 0x7f467c070a70 2024-09-11T01:01:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.560+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c1f40c0 con 0x7f467c070a70 2024-09-11T01:01:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.562+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c15af20 con 0x7f467c070a70 2024-09-11T01:01:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.563+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f466800a7e0 con 0x7f467c070a70 2024-09-11T01:01:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.564+0000 7f4679600640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 0x7f465c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.564+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f46680996a0 con 0x7f467c070a70 2024-09-11T01:01:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.564+0000 7f4681c00640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 0x7f465c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.565+0000 7f4681c00640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 0x7f465c07a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f467000bb50 tx=0x7f467000b2e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.570+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f467c15b460 con 0x7f467c070a70 2024-09-11T01:01:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.827+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f467c0b4290 con 0x7f467c070a70 2024-09-11T01:01:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.827+0000 7f4679600640 1 -- 172.21.15.81:0/3072931114 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f46680617d0 con 0x7f467c070a70 2024-09-11T01:01:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:01:52.829 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:01:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:01:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 msgr2=0x7f465c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 0x7f465c07a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f467000bb50 tx=0x7f467000b2e0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 msgr2=0x7f467c14ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f466800c730 tx=0x7f466800cbf0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 shutdown_connections 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f465c077f70 0x7f465c07a430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f467c154680 0x7f467c14bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f467c070a70 0x7f467c14ba80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 --2- 172.21.15.81:0/3072931114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f467c06daf0 0x7f467c1e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 >> 172.21.15.81:0/3072931114 conn(0x7f467c0cdf20 msgr2=0x7f467c14dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 shutdown_connections 2024-09-11T01:01:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:52.830+0000 7f4683000640 1 -- 172.21.15.81:0/3072931114 wait complete. 2024-09-11T01:01:52.849 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0' 2024-09-11T01:01:52.849 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0 2024-09-11T01:01:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 -- 172.21.15.81:0/536614687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 msgr2=0x7fdef40cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 --2- 172.21.15.81:0/536614687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef40cadf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdef40cde90 tx=0x7fdee802a5d0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 -- 172.21.15.81:0/536614687 shutdown_connections 2024-09-11T01:01:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 --2- 172.21.15.81:0/536614687 >> v2:172.21.15.167:3300/0 conn(0x7fdef40c5670 0x7fdef40cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 --2- 172.21.15.81:0/536614687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef40cadf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 -- 172.21.15.81:0/536614687 >> 172.21.15.81:0/536614687 conn(0x7fdef40688e0 msgr2=0x7fdef4068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.041+0000 7fdefa200640 1 -- 172.21.15.81:0/536614687 shutdown_connections 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.042+0000 7fdefa200640 1 -- 172.21.15.81:0/536614687 wait complete. 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.043+0000 7fdefa200640 1 Processor -- start 2024-09-11T01:01:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.043+0000 7fdefa200640 1 -- start start 2024-09-11T01:01:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 0x7fdef41505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdef415a500 con 0x7fdef4154810 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdef415b0b0 con 0x7fdef40cc030 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.044+0000 7fdefa200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdef40c5e20 con 0x7fdef40c5670 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 0x7fdef41505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:49660/0 (socket says 172.21.15.81:49660) 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 -- 172.21.15.81:0/1379441975 learned_addr learned my addr 172.21.15.81:0/1379441975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 -- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 msgr2=0x7fdef41505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 0x7fdef41505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 -- 172.21.15.81:0/1379441975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 msgr2=0x7fdef414d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef414d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 -- 172.21.15.81:0/1379441975 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4150110 con 0x7fdef40c5670 2024-09-11T01:01:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef9800640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:01:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef3e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 0x7fdef41505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:01:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.045+0000 7fdef8e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdee80098f0 tx=0x7fdee80316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.046+0000 7fdef0c00640 1 -- 172.21.15.81:0/1379441975 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8033e00 con 0x7fdef40c5670 2024-09-11T01:01:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.046+0000 7fdef0c00640 1 -- 172.21.15.81:0/1379441975 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee8031a40 con 0x7fdef40c5670 2024-09-11T01:01:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.046+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41e5f60 con 0x7fdef40c5670 2024-09-11T01:01:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.046+0000 7fdef0c00640 1 -- 172.21.15.81:0/1379441975 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8031e30 con 0x7fdef40c5670 2024-09-11T01:01:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.046+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef414d720 con 0x7fdef40c5670 2024-09-11T01:01:53.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.049+0000 7fdef0c00640 1 -- 172.21.15.81:0/1379441975 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdee80330d0 con 0x7fdef40c5670 2024-09-11T01:01:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.050+0000 7fdef0c00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 0x7fded407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.050+0000 7fdefe5f8740 1 Processor -- start 2024-09-11T01:01:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.050+0000 7fdef0c00640 1 -- 172.21.15.81:0/1379441975 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdee80badb0 con 0x7fdef40c5670 2024-09-11T01:01:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.050+0000 7fdefe5f8740 1 -- start start 2024-09-11T01:01:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.050+0000 7fdef3e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 0x7fded407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb7077c0 0x5589bb707ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef3e00640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 0x7fded407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdef41e5a30 tx=0x7fdee0009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb70e0c0 0x5589bb70e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5589bb680260 con 0x5589bb74bba0 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5589bb66f690 con 0x5589bb7077c0 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5589bb6734a0 con 0x5589bb70e0c0 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb70e0c0 0x5589bb70e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55044/0 (socket says 172.21.15.81:55044) 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 -- 172.21.15.81:0/2722037344 learned_addr learned my addr 172.21.15.81:0/2722037344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef8e00640 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb7077c0 0x5589bb707ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 -- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb70e0c0 msgr2=0x5589bb70e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb70e0c0 0x5589bb70e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 -- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb7077c0 msgr2=0x5589bb707ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb7077c0 0x5589bb707ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.051+0000 7fdef9800640 1 -- 172.21.15.81:0/2722037344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589bb449d80 con 0x5589bb74bba0 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.052+0000 7fdef9800640 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdeec011810 tx=0x7fdeec011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee58661621d1e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.052+0000 7fdee5600640 1 -- 172.21.15.81:0/2722037344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011310 con 0x5589bb74bba0 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.052+0000 7fdee5600640 1 -- 172.21.15.81:0/2722037344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeec003a60 con 0x5589bb74bba0 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.052+0000 7fdee5600640 1 -- 172.21.15.81:0/2722037344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00f9a0 con 0x5589bb74bba0 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2722037344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 msgr2=0x5589bb742d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdeec011810 tx=0x7fdeec011cd0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2722037344 shutdown_connections 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb742d10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb70e0c0 0x5589bb70e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2722037344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb7077c0 0x5589bb707ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2722037344 >> 172.21.15.81:0/2722037344 conn(0x5589bb709520 msgr2=0x5589bb70cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2722037344 shutdown_connections 2024-09-11T01:01:53.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.053+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2722037344 wait complete. 2024-09-11T01:01:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.054+0000 7fdefe5f8740 1 -- start start 2024-09-11T01:01:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.054+0000 7fdefe5f8740 1 Processor -- start 2024-09-11T01:01:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb75de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb736cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5589bb3dfcc0 con 0x5589bb74bba0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5589bb614e60 con 0x5589bb70e0c0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5589bb70d500 con 0x5589bb738280 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdefe5f8740 10 client.0 _ll_register_callbacks cb 0x5589bb61b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.055+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb736cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:49678/0 (socket says 172.21.15.81:49678) 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb75de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 -- 172.21.15.81:0/3879215675 learned_addr learned my addr 172.21.15.81:0/3879215675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 -- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 msgr2=0x5589bb75de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb75de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 -- 172.21.15.81:0/3879215675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 msgr2=0x5589bb736cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb736cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 -- 172.21.15.81:0/3879215675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5589bb4aa510 con 0x5589bb738280 2024-09-11T01:01:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef3e00640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb736cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:01:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdef9800640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdeec016000 tx=0x7fdeec011340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd04d832be27ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.056+0000 7fdeda000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T01:01:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec029060 con 0x5589bb738280 2024-09-11T01:01:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdeec00fdb0 con 0x5589bb738280 2024-09-11T01:01:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec003a60 con 0x5589bb738280 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdeec02f050 con 0x5589bb738280 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 10 client.5213 fetch_fsmap learned FSMap version 9 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5589bb3aec20 con 0x5589bb738280 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeec003a60 con 0x5589bb738280 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdeec032020 con 0x5589bb738280 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 10 client.5213 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 10 client.5213 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.057+0000 7fdefe5f8740 20 client.5213 populate_metadata read hostname 'smithi081' 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.058+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb735870 0x5589bb735c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.058+0000 7fdefe5f8740 4 client.5213 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.058+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589bb6821b0 con 0x5589bb735870 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.058+0000 7fdef8e00640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb735870 0x5589bb735c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.059+0000 7fdeda000640 10 client.5213 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:01:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.059+0000 7fdef8e00640 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb735870 0x5589bb735c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f3f61f5d7abad7 server_cookie=6f42831b3252712c in_seq=0 out_seq=0 2024-09-11T01:01:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.059+0000 7fdeda000640 1 -- 172.21.15.81:0/3879215675 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589bb6821b0 con 0x5589bb735870 2024-09-11T01:01:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.059+0000 7fdeda000640 10 client.5213 handle_command_reply: tid=0 2024-09-11T01:01:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.059+0000 7fdefe5f8740 1 client.5213 shutdown 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 msgr2=0x5589bb734930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdeec016000 tx=0x7fdeec011340 comp rx=0 tx=0).stop 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 shutdown_connections 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb735870 0x5589bb735c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb734930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb74bba0 0x5589bb736cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdeda000640 0 client.5213 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3879215675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb75de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 >> 172.21.15.81:0/3879215675 conn(0x5589bb7077c0 msgr2=0x5589bb706460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 shutdown_connections 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3879215675 wait complete. 2024-09-11T01:01:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.060+0000 7fdefe5f8740 20 client.5213 trim_cache size 0 max 16384 2024-09-11T01:01:53.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.084+0000 7fdefe5f8740 1 Processor -- start 2024-09-11T01:01:53.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.084+0000 7fdefe5f8740 1 -- start start 2024-09-11T01:01:53.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb7086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 0x5589bb73abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41ff1c0 con 0x5589bb738280 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41fe0a0 con 0x5589bb70e0c0 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdef41f4880 con 0x5589bb74bba0 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.085+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55062/0 (socket says 172.21.15.81:55062) 2024-09-11T01:01:53.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 -- 172.21.15.81:0/3614560830 learned_addr learned my addr 172.21.15.81:0/3614560830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef8e00640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb7086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef9800640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 0x5589bb73abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 -- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 msgr2=0x5589bb73abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 0x5589bb73abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 -- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 msgr2=0x5589bb7086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb7086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 -- 172.21.15.81:0/3614560830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589bb73dfe0 con 0x5589bb738280 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef9800640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 0x5589bb73abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.086+0000 7fdef3e00640 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdee00147d0 tx=0x7fdee0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050f2efc3b872c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdee4c00640 1 -- 172.21.15.81:0/3614560830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0013930 con 0x5589bb738280 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdee4c00640 1 -- 172.21.15.81:0/3614560830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee001b040 con 0x5589bb738280 2024-09-11T01:01:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdee4c00640 1 -- 172.21.15.81:0/3614560830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0013de0 con 0x5589bb738280 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3614560830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 msgr2=0x5589bb708bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdee00147d0 tx=0x7fdee0012000 comp rx=0 tx=0).stop 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3614560830 shutdown_connections 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb74bba0 0x5589bb73abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb738280 0x5589bb708bf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/3614560830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb70e0c0 0x5589bb7086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3614560830 >> 172.21.15.81:0/3614560830 conn(0x5589bb7077c0 msgr2=0x5589bb70e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.087+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3614560830 shutdown_connections 2024-09-11T01:01:53.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.088+0000 7fdefe5f8740 1 -- 172.21.15.81:0/3614560830 wait complete. 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.088+0000 7fdefe5f8740 1 -- start start 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.088+0000 7fdefe5f8740 1 Processor -- start 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb7332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 0x5589bb734370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41fcd40 con 0x5589bb70e0c0 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41fd9d0 con 0x5589bb74bba0 2024-09-11T01:01:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdef41fd360 con 0x5589bb738280 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.089+0000 7fdefe5f8740 10 client.0 _ll_register_callbacks cb 0x7fdeec0116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55066/0 (socket says 172.21.15.81:55066) 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 -- 172.21.15.81:0/2698226165 learned_addr learned my addr 172.21.15.81:0/2698226165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef9800640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 0x5589bb734370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef3e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb7332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 -- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 msgr2=0x5589bb7332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb7332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 -- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 msgr2=0x5589bb734370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 0x5589bb734370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 -- 172.21.15.81:0/2698226165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589bb709130 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef9800640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 0x5589bb734370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdef8e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdee80b8f70 tx=0x7fdee802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5012701c14b414d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.090+0000 7fdeda000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8085040 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdee807f160 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdee001b040 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdee8048040 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 10 client.5547 fetch_fsmap learned FSMap version 9 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5589bb706ac0 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee001b040 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdee8083150 con 0x5589bb70e0c0 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 10 client.5547 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:01:53.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 10 client.5547 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 20 client.5547 populate_metadata read hostname 'smithi081' 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb733800 0x5589bb7348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 4 client.5547 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}] 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.091+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}) -- 0x5589bb736620 con 0x5589bb733800 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.092+0000 7fdef3e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb733800 0x5589bb7348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.092+0000 7fdef3e00640 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb733800 0x5589bb7348b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9d7321cd6e6e47 server_cookie=5da0ffaaf35fcf11 in_seq=0 out_seq=0 2024-09-11T01:01:53.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.092+0000 7fdeda000640 10 client.5547 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:01:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdeda000640 1 -- 172.21.15.81:0/2698226165 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5589bb736620 con 0x5589bb733800 2024-09-11T01:01:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdeda000640 10 client.5547 handle_command_reply: tid=0 2024-09-11T01:01:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 client.5547 shutdown 2024-09-11T01:01:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 msgr2=0x5589bb73b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdee80b8f70 tx=0x7fdee802a5d0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 shutdown_connections 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5589bb733800 0x5589bb7348b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589bb74bba0 0x5589bb734370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589bb738280 0x5589bb7332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdeda000640 0 client.5547 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 --2- 172.21.15.81:0/2698226165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bb70e0c0 0x5589bb73b190 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 >> 172.21.15.81:0/2698226165 conn(0x5589bb7077c0 msgr2=0x5589bb7086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 shutdown_connections 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 1 -- 172.21.15.81:0/2698226165 wait complete. 2024-09-11T01:01:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.173+0000 7fdefe5f8740 20 client.5547 trim_cache size 0 max 16384 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 54, 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "e91395c9": { 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 54, 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:01:53.177 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 141.0, 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:01:53.178 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:01:53.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:01:53.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:01:53.180 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 msgr2=0x7fded407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 0x7fded407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdef41e5a30 tx=0x7fdee0009040 comp rx=0 tx=0).stop 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 msgr2=0x7fdef41f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdee80098f0 tx=0x7fdee80316b0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 shutdown_connections 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fded4077f70 0x7fded407a430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef4154810 0x7fdef414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef40cc030 0x7fdef41505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 --2- 172.21.15.81:0/1379441975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef40c5670 0x7fdef41f2470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 >> 172.21.15.81:0/1379441975 conn(0x7fdef40688e0 msgr2=0x7fdef40d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 shutdown_connections 2024-09-11T01:01:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:01:53.174+0000 7fdefa200640 1 -- 172.21.15.81:0/1379441975 wait complete. 2024-09-11T01:01:53.190 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e91395c9', quiesce took 0.8 seconds. Will release after: 20.2 2024-09-11T01:02:13.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 -- 172.21.15.81:0/3344855794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 msgr2=0x7f85980c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 --2- 172.21.15.81:0/3344855794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980c7980 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8598074fb0 tx=0x7f858402a670 comp rx=0 tx=0).stop 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 -- 172.21.15.81:0/3344855794 shutdown_connections 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 --2- 172.21.15.81:0/3344855794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85980c8680 0x7f85980c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 --2- 172.21.15.81:0/3344855794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980c7980 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 -- 172.21.15.81:0/3344855794 >> 172.21.15.81:0/3344855794 conn(0x7f85980700f0 msgr2=0x7f8598070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 -- 172.21.15.81:0/3344855794 shutdown_connections 2024-09-11T01:02:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.559+0000 7f859fc00640 1 -- 172.21.15.81:0/3344855794 wait complete. 2024-09-11T01:02:13.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.560+0000 7f859fc00640 1 Processor -- start 2024-09-11T01:02:13.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 -- start start 2024-09-11T01:02:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8598152610 0x7f85981f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85980b0a10 0x7f85981f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8598070cf0 con 0x7f8598074860 2024-09-11T01:02:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f859815c140 con 0x7f85980b0a10 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.561+0000 7f859fc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f85980c16a0 con 0x7f8598152610 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50046/0 (socket says 172.21.15.81:50046) 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 -- 172.21.15.81:0/1112956895 learned_addr learned my addr 172.21.15.81:0/1112956895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859dc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85980b0a10 0x7f85981f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f8597e00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8598152610 0x7f85981f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 -- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8598152610 msgr2=0x7f85981f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8598152610 0x7f85981f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 -- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85980b0a10 msgr2=0x7f85981f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85980b0a10 0x7f85981f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 -- 172.21.15.81:0/1112956895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598155f00 con 0x7f8598074860 2024-09-11T01:02:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.562+0000 7f859d200640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c480 tx=0x7f858c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.563+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0052d0 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.563+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f858c005470 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.563+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c012870 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.563+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8598152ff0 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.563+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8598153290 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.564+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8598150bb0 con 0x7f8598074860 2024-09-11T01:02:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.565+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f858c0035f0 con 0x7f8598074860 2024-09-11T01:02:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.566+0000 7f8594c00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.566+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f858c099d50 con 0x7f8598074860 2024-09-11T01:02:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.566+0000 7f8597e00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.567+0000 7f8597e00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 0x7f857807a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8584033000 tx=0x7f8584004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.570+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8598150bb0 con 0x7f8598074860 2024-09-11T01:02:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.789+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85981529f0 con 0x7f8598074860 2024-09-11T01:02:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.790+0000 7f8594c00640 1 -- 172.21.15.81:0/1112956895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f858c0624d0 con 0x7f8598074860 2024-09-11T01:02:13.792 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:02:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:02:13.793 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 msgr2=0x7f857807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 0x7f857807a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8584033000 tx=0x7f8584004730 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 msgr2=0x7f85980cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c480 tx=0x7f858c00c940 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 shutdown_connections 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85980b0a10 0x7f85981f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8598152610 0x7f85981f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 --2- 172.21.15.81:0/1112956895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8598074860 0x7f85980cb700 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 >> 172.21.15.81:0/1112956895 conn(0x7f85980700f0 msgr2=0x7f859806f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.792+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 shutdown_connections 2024-09-11T01:02:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.793+0000 7f859fc00640 1 -- 172.21.15.81:0/1112956895 wait complete. 2024-09-11T01:02:13.811 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id e91395c9 --release --await' 2024-09-11T01:02:13.811 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id e91395c9 --release --await 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 -- 172.21.15.81:0/530942540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 msgr2=0x7f94e00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 --2- 172.21.15.81:0/530942540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00c7760 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f94e0070b40 tx=0x7f94cc02a560 comp rx=0 tx=0).stop 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 -- 172.21.15.81:0/530942540 shutdown_connections 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 --2- 172.21.15.81:0/530942540 >> v2:172.21.15.167:3300/0 conn(0x7f94e015baa0 0x7f94e015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 --2- 172.21.15.81:0/530942540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00c7760 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 --2- 172.21.15.81:0/530942540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e006f760 0x7f94e0070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 -- 172.21.15.81:0/530942540 >> 172.21.15.81:0/530942540 conn(0x7f94e006ff90 msgr2=0x7f94e00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 -- 172.21.15.81:0/530942540 shutdown_connections 2024-09-11T01:02:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.973+0000 7f94e7a00640 1 -- 172.21.15.81:0/530942540 wait complete. 2024-09-11T01:02:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.975+0000 7f94e7a00640 1 Processor -- start 2024-09-11T01:02:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.975+0000 7f94e7a00640 1 -- start start 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e006f760 0x7f94e01e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e015baa0 0x7f94e0155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0074db0 con 0x7f94e00c7360 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0074ad0 con 0x7f94e006f760 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e7a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94e00c6e40 con 0x7f94e015baa0 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53932/0 (socket says 172.21.15.81:53932) 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94dfe00640 1 -- 172.21.15.81:0/2584070119 learned_addr learned my addr 172.21.15.81:0/2584070119 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e5a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e015baa0 0x7f94e0155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.976+0000 7f94e5000640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e006f760 0x7f94e01e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 -- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e015baa0 msgr2=0x7f94e0155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e015baa0 0x7f94e0155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 -- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e006f760 msgr2=0x7f94e01e0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e006f760 0x7f94e01e0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 -- 172.21.15.81:0/2584070119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e01f1dc0 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dfe00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009850 tx=0x7f94cc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dcc00640 1 -- 172.21.15.81:0/2584070119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc03f070 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dcc00640 1 -- 172.21.15.81:0/2584070119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94cc0047a0 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94dcc00640 1 -- 172.21.15.81:0/2584070119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc035030 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e01f50e0 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.977+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e01f12e0 con 0x7f94e00c7360 2024-09-11T01:02:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.979+0000 7f94dcc00640 1 -- 172.21.15.81:0/2584070119 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f94cc004bb0 con 0x7f94e00c7360 2024-09-11T01:02:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.981+0000 7f94dcc00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 0x7f94c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.981+0000 7f94dcc00640 1 -- 172.21.15.81:0/2584070119 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f94cc0bb0f0 con 0x7f94e00c7360 2024-09-11T01:02:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.981+0000 7f94e5000640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 0x7f94c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.981+0000 7f94ea9fb740 1 Processor -- start 2024-09-11T01:02:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 -- start start 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94e5000640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 0x7f94c007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009b50 tx=0x7f94d0005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58a8b80 0x5618d58f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5618d581d370 con 0x5618d58a5910 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5618d580c7a0 con 0x5618d58a8b80 2024-09-11T01:02:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.982+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5618d58105b0 con 0x5618d58ea810 2024-09-11T01:02:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58a8b80 0x5618d58f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53946/0 (socket says 172.21.15.81:53946) 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 -- 172.21.15.81:0/1237638208 learned_addr learned my addr 172.21.15.81:0/1237638208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 -- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 msgr2=0x5618d58e0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 -- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58a8b80 msgr2=0x5618d58f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58a8b80 0x5618d58f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 -- 172.21.15.81:0/1237638208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d57a5010 con 0x5618d58a5910 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.983+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009ef0 tx=0x7f94d8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a378f640276e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94d5600640 1 -- 172.21.15.81:0/1237638208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8004d20 con 0x5618d58a5910 2024-09-11T01:02:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94d5600640 1 -- 172.21.15.81:0/1237638208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d8003a30 con 0x5618d58a5910 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94d5600640 1 -- 172.21.15.81:0/1237638208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8003e20 con 0x5618d58a5910 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1237638208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 msgr2=0x5618d58e08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009ef0 tx=0x7f94d8011810 comp rx=0 tx=0).stop 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1237638208 shutdown_connections 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a5910 0x5618d58e08d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1237638208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58a8b80 0x5618d58f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1237638208 >> 172.21.15.81:0/1237638208 conn(0x5618d58a6d60 msgr2=0x5618d58a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1237638208 shutdown_connections 2024-09-11T01:02:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.984+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1237638208 wait complete. 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.985+0000 7f94ea9fb740 1 -- start start 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.985+0000 7f94ea9fb740 1 Processor -- start 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58eff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5618d57b3f70 con 0x5618d58a8b80 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5618d57b2090 con 0x5618d58efb10 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5618d58f2440 con 0x5618d58ea810 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.986+0000 7f94ea9fb740 10 client.0 _ll_register_callbacks cb 0x5618d551b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53960/0 (socket says 172.21.15.81:53960) 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 -- 172.21.15.81:0/1144966014 learned_addr learned my addr 172.21.15.81:0/1144966014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 -- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 msgr2=0x5618d58e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 -- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 msgr2=0x5618d58eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58eff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 -- 172.21.15.81:0/1144966014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d556eea0 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94e5000640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003970 tx=0x7f94d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c3249cc8274e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94ca000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d001fdc0 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f94d00273e0 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.987+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94d8003a30 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f94d00275e0 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 10 client.5565 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5618d55e7d30 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d8003a30 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f94d0030050 con 0x5618d58a8b80 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 10 client.5565 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 10 client.5565 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 20 client.5565 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58db120 0x5618d58db570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 4 client.5565 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.988+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618d581f2c0 con 0x5618d58db120 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.989+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58db120 0x5618d58db570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.989+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58db120 0x5618d58db570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264018965b1c87e4 server_cookie=3885668a1a08ff2a in_seq=0 out_seq=0 2024-09-11T01:02:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.989+0000 7f94ca000640 10 client.5565 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ca000640 1 -- 172.21.15.81:0/1144966014 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618d581f2c0 con 0x5618d58db120 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ca000640 10 client.5565 handle_command_reply: tid=0 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 client.5565 shutdown 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 msgr2=0x5618d58f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003970 tx=0x7f94d0004730 comp rx=0 tx=0).stop 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 shutdown_connections 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58db120 0x5618d58db570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d58e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1144966014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58f1a30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ca000640 0 client.5565 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 >> 172.21.15.81:0/1144966014 conn(0x5618d58a5910 msgr2=0x5618d58aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 shutdown_connections 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.990+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1144966014 wait complete. 2024-09-11T01:02:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:13.991+0000 7f94ea9fb740 20 client.5565 trim_cache size 0 max 16384 2024-09-11T01:02:14.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.008+0000 7f94ea9fb740 1 Processor -- start 2024-09-11T01:02:14.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.008+0000 7f94ea9fb740 1 -- start start 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58a8b80 0x5618d58aad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01ff590 con 0x5618d58ea810 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01fe470 con 0x5618d58efb10 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94e00c4a20 con 0x5618d58a8b80 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53972/0 (socket says 172.21.15.81:53972) 2024-09-11T01:02:14.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 -- 172.21.15.81:0/333348751 learned_addr learned my addr 172.21.15.81:0/333348751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94e5000640 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58a8b80 0x5618d58aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94e5a00640 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 -- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58a8b80 msgr2=0x5618d58aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58a8b80 0x5618d58aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 -- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 msgr2=0x5618d58a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.009+0000 7f94dfe00640 1 -- 172.21.15.81:0/333348751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d58d4fc0 con 0x5618d58ea810 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94dfe00640 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc0b90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96edddb65938e09d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94d4c00640 1 -- 172.21.15.81:0/333348751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc049040 con 0x5618d58ea810 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94d4c00640 1 -- 172.21.15.81:0/333348751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94cc083190 con 0x5618d58ea810 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94d4c00640 1 -- 172.21.15.81:0/333348751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc087bc0 con 0x5618d58ea810 2024-09-11T01:02:14.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 -- 172.21.15.81:0/333348751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 msgr2=0x5618d58ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc0b90e0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 -- 172.21.15.81:0/333348751 shutdown_connections 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d58a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58ea810 0x5618d58ab250 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/333348751 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58a8b80 0x5618d58aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.010+0000 7f94ea9fb740 1 -- 172.21.15.81:0/333348751 >> 172.21.15.81:0/333348751 conn(0x5618d58a5910 msgr2=0x5618d58a61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.011+0000 7f94ea9fb740 1 -- 172.21.15.81:0/333348751 shutdown_connections 2024-09-11T01:02:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.011+0000 7f94ea9fb740 1 -- 172.21.15.81:0/333348751 wait complete. 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.011+0000 7f94ea9fb740 1 -- start start 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.011+0000 7f94ea9fb740 1 Processor -- start 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d59655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d5965b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01fd290 con 0x5618d58a8b80 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01fddd0 con 0x5618d58efb10 2024-09-11T01:02:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94e01fd720 con 0x5618d58ea810 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94ea9fb740 10 client.0 _ll_register_callbacks cb 0x7f94d0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.012+0000 7f94e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53976/0 (socket says 172.21.15.81:53976) 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 -- 172.21.15.81:0/1245106124 learned_addr learned my addr 172.21.15.81:0/1245106124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d59655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5a00640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d5965b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 -- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 msgr2=0x5618d59655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d59655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 -- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 msgr2=0x5618d5965b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d5965b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 -- 172.21.15.81:0/1245106124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d58f0c20 con 0x5618d58a8b80 2024-09-11T01:02:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94e5000640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003970 tx=0x7f94d0011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1c34ed6f3e29d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94ca000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0027ad0 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f94d0027c70 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.013+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94cc083190 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f94d0027e70 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 10 client.5571 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5618d58e7f30 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94cc083190 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f94d0030040 con 0x5618d58a8b80 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 10 client.5571 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 10 client.5571 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 20 client.5571 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:14.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58d08f0 0x5618d596eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 4 client.5571 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e91395c9", "release": true, "await": true}] 2024-09-11T01:02:14.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e91395c9", "release": true, "await": true}) -- 0x5618d581ad70 con 0x5618d58d08f0 2024-09-11T01:02:14.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.014+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58d08f0 0x5618d596eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.015+0000 7f94dfe00640 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58d08f0 0x5618d596eed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329ae4d763e12400 server_cookie=a20b77c2359b977c in_seq=0 out_seq=0 2024-09-11T01:02:14.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.015+0000 7f94ca000640 10 client.5571 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ca000640 1 -- 172.21.15.81:0/1245106124 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5618d581ad70 con 0x5618d58d08f0 2024-09-11T01:02:14.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ca000640 10 client.5571 handle_command_reply: tid=0 2024-09-11T01:02:14.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 client.5571 shutdown 2024-09-11T01:02:14.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 msgr2=0x5618d58e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003970 tx=0x7f94d0011950 comp rx=0 tx=0).stop 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 shutdown_connections 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5618d58d08f0 0x5618d596eed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d58efb10 0x5618d5965b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5618d58ea810 0x5618d59655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 --2- 172.21.15.81:0/1245106124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618d58a8b80 0x5618d58e73e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ca000640 0 client.5571 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 >> 172.21.15.81:0/1245106124 conn(0x5618d58a5910 msgr2=0x5618d58a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 shutdown_connections 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 1 -- 172.21.15.81:0/1245106124 wait complete. 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.034+0000 7f94ea9fb740 20 client.5571 trim_cache size 0 max 16384 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 56, 2024-09-11T01:02:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "e91395c9": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 56, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 141.0, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.041 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 msgr2=0x7f94c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 0x7f94c007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009b50 tx=0x7f94d0005f90 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 msgr2=0x7f94e00aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009850 tx=0x7f94cc0038a0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 shutdown_connections 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f94c0077f70 0x7f94c007a430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e015baa0 0x7f94e0155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e00c7360 0x7f94e00aef80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 --2- 172.21.15.81:0/2584070119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e006f760 0x7f94e01e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 >> 172.21.15.81:0/2584070119 conn(0x7f94e006ff90 msgr2=0x7f94e00725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 shutdown_connections 2024-09-11T01:02:14.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.035+0000 7f94e7a00640 1 -- 172.21.15.81:0/2584070119 wait complete. 2024-09-11T01:02:14.053 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e91395c9', total seconds elapsed: 21.7 2024-09-11T01:02:14.053 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.0 2024-09-11T01:02:14.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:02:14.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.219+0000 7f1e05000640 1 -- 172.21.15.81:0/2345196545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e00154760 msgr2=0x7f1e0015e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.219+0000 7f1e05000640 1 --2- 172.21.15.81:0/2345196545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e00154760 0x7f1e0015e410 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009830 tx=0x7f1df002a5a0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 -- 172.21.15.81:0/2345196545 shutdown_connections 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 --2- 172.21.15.81:0/2345196545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e000cafb0 0x7f1e000cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 --2- 172.21.15.81:0/2345196545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e00154760 0x7f1e0015e410 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 -- 172.21.15.81:0/2345196545 >> 172.21.15.81:0/2345196545 conn(0x7f1e000688e0 msgr2=0x7f1e00068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 -- 172.21.15.81:0/2345196545 shutdown_connections 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.220+0000 7f1e05000640 1 -- 172.21.15.81:0/2345196545 wait complete. 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.221+0000 7f1e05000640 1 Processor -- start 2024-09-11T01:02:14.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.221+0000 7f1e05000640 1 -- start start 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e000cff30 0x7f1e000c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e00154760 0x7f1e001458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000ccc10 con 0x7f1e000cafb0 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000cc930 con 0x7f1e000cff30 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1e05000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1e00154b40 con 0x7f1e00154760 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.222+0000 7f1dff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53984/0 (socket says 172.21.15.81:53984) 2024-09-11T01:02:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 -- 172.21.15.81:0/3615815282 learned_addr learned my addr 172.21.15.81:0/3615815282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dfea00640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e000cff30 0x7f1e000c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dffe00640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e00154760 0x7f1e001458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 -- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e00154760 msgr2=0x7f1e001458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e00154760 0x7f1e001458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 -- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e000cff30 msgr2=0x7f1e000c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e000cff30 0x7f1e000c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 -- 172.21.15.81:0/3615815282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000c8120 con 0x7f1e000cafb0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.223+0000 7f1dff400640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1df002ab90 tx=0x7f1df0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.224+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0005c90 con 0x7f1e000cafb0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.224+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df0031e50 con 0x7f1e000cafb0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.224+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0005260 con 0x7f1e000cafb0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.224+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0014fdd0 con 0x7f1e000cafb0 2024-09-11T01:02:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.224+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e00150070 con 0x7f1e000cafb0 2024-09-11T01:02:14.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.225+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e00150720 con 0x7f1e000cafb0 2024-09-11T01:02:14.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.226+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1df0005400 con 0x7f1e000cafb0 2024-09-11T01:02:14.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.227+0000 7f1df7400640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 0x7f1de007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.227+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1df00bb120 con 0x7f1e000cafb0 2024-09-11T01:02:14.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.228+0000 7f1dfea00640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 0x7f1de007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.228+0000 7f1dfea00640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 0x7f1de007a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e000ce040 tx=0x7f1dec00b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.233+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1df003f030 con 0x7f1e000cafb0 2024-09-11T01:02:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.500+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e00150960 con 0x7f1e000cafb0 2024-09-11T01:02:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.501+0000 7f1df7400640 1 -- 172.21.15.81:0/3615815282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f1df00831c0 con 0x7f1e000cafb0 2024-09-11T01:02:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:02:14.503 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:02:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 msgr2=0x7f1de007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 0x7f1de007a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e000ce040 tx=0x7f1dec00b390 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 msgr2=0x7f1e000b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1df002ab90 tx=0x7f1df0033c20 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 shutdown_connections 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1de0077f70 0x7f1de007a430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e00154760 0x7f1e001458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e000cff30 0x7f1e000c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 --2- 172.21.15.81:0/3615815282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e000cafb0 0x7f1e000b5200 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.503+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 >> 172.21.15.81:0/3615815282 conn(0x7f1e000688e0 msgr2=0x7f1e00150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.504+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 shutdown_connections 2024-09-11T01:02:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.504+0000 7f1e05000640 1 -- 172.21.15.81:0/3615815282 wait complete. 2024-09-11T01:02:14.522 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0' 2024-09-11T01:02:14.523 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0 2024-09-11T01:02:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 -- 172.21.15.81:0/463171687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 msgr2=0x7f9cc80cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/463171687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc80cadf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80cde90 tx=0x7f9cb802a5f0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 -- 172.21.15.81:0/463171687 shutdown_connections 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/463171687 >> v2:172.21.15.167:3300/0 conn(0x7f9cc80c5670 0x7f9cc80cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/463171687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc80cadf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.711+0000 7f9cc7e00640 1 -- 172.21.15.81:0/463171687 >> 172.21.15.81:0/463171687 conn(0x7f9cc80688e0 msgr2=0x7f9cc8068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.712+0000 7f9cc7e00640 1 -- 172.21.15.81:0/463171687 shutdown_connections 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.712+0000 7f9cc7e00640 1 -- 172.21.15.81:0/463171687 wait complete. 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.713+0000 7f9cc7e00640 1 Processor -- start 2024-09-11T01:02:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.713+0000 7f9cc7e00640 1 -- start start 2024-09-11T01:02:14.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 0x7f9cc80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc80cc030 0x7f9cc81580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc815a500 con 0x7f9cc8154810 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc815b0b0 con 0x7f9cc80c5670 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.714+0000 7f9cc7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc80c5e20 con 0x7f9cc80cc030 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 0x7f9cc80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54004/0 (socket says 172.21.15.81:54004) 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 -- 172.21.15.81:0/3431156388 learned_addr learned my addr 172.21.15.81:0/3431156388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 0x7f9cc80c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:33932/0 (socket says 172.21.15.81:33932) 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc6000640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc80cc030 0x7f9cc81580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 -- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc80cc030 msgr2=0x7f9cc81580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc80cc030 0x7f9cc81580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 -- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 msgr2=0x7f9cc80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 0x7f9cc80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 -- 172.21.15.81:0/3431156388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc80b5180 con 0x7f9cc8154810 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.715+0000 7f9cc7400640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000eaa0 tx=0x7f9cc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.716+0000 7f9cbea00640 1 -- 172.21.15.81:0/3431156388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000cd50 con 0x7f9cc8154810 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.716+0000 7f9cbea00640 1 -- 172.21.15.81:0/3431156388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cc0004b20 con 0x7f9cc8154810 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.716+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc80b5460 con 0x7f9cc8154810 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.716+0000 7f9cbea00640 1 -- 172.21.15.81:0/3431156388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0005020 con 0x7f9cc8154810 2024-09-11T01:02:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.716+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc80b5a20 con 0x7f9cc8154810 2024-09-11T01:02:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.719+0000 7f9cbea00640 1 -- 172.21.15.81:0/3431156388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9cc000f040 con 0x7f9cc8154810 2024-09-11T01:02:14.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.720+0000 7f9cbea00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 0x7f9ca807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.720+0000 7f9cd0c71740 1 Processor -- start 2024-09-11T01:02:14.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.720+0000 7f9cbea00640 1 -- 172.21.15.81:0/3431156388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9cc009a670 con 0x7f9cc8154810 2024-09-11T01:02:14.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.720+0000 7f9cd0c71740 1 -- start start 2024-09-11T01:02:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 0x7f9ca807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65797c0 0x55b2f6579ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 0x7f9ca807a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8033000 tx=0x7f9cb8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65800c0 0x55b2f6580800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2f64f2260 con 0x55b2f65bdba0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b2f64e1690 con 0x55b2f65797c0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.721+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b2f64e54a0 con 0x55b2f65800c0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54016/0 (socket says 172.21.15.81:54016) 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 -- 172.21.15.81:0/695749 learned_addr learned my addr 172.21.15.81:0/695749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc6000640 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65800c0 0x55b2f6580800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65797c0 0x55b2f6579ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 -- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65800c0 msgr2=0x55b2f6580800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65800c0 0x55b2f6580800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 -- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65797c0 msgr2=0x55b2f6579ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65797c0 0x55b2f6579ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 -- 172.21.15.81:0/695749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f62bbd80 con 0x55b2f65bdba0 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.722+0000 7f9cc7400640 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000efd0 tx=0x7f9cc00626a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb872886fefc3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.723+0000 7f9cb3400640 1 -- 172.21.15.81:0/695749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc001f040 con 0x55b2f65bdba0 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.723+0000 7f9cb3400640 1 -- 172.21.15.81:0/695749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cc004c020 con 0x55b2f65bdba0 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.723+0000 7f9cb3400640 1 -- 172.21.15.81:0/695749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0088180 con 0x55b2f65bdba0 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 -- 172.21.15.81:0/695749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 msgr2=0x55b2f65b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000efd0 tx=0x7f9cc00626a0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 -- 172.21.15.81:0/695749 shutdown_connections 2024-09-11T01:02:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65b4d10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65800c0 0x55b2f6580800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/695749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65797c0 0x55b2f6579ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 -- 172.21.15.81:0/695749 >> 172.21.15.81:0/695749 conn(0x55b2f657b520 msgr2=0x55b2f657edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 -- 172.21.15.81:0/695749 shutdown_connections 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.724+0000 7f9cd0c71740 1 -- 172.21.15.81:0/695749 wait complete. 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.725+0000 7f9cd0c71740 1 -- start start 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.725+0000 7f9cd0c71740 1 Processor -- start 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2f6251cc0 con 0x55b2f65bdba0 2024-09-11T01:02:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b2f6486e60 con 0x55b2f65800c0 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b2f657f500 con 0x55b2f65b1690 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cd0c71740 10 client.0 _ll_register_callbacks cb 0x55b2f648d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54030/0 (socket says 172.21.15.81:54030) 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 -- 172.21.15.81:0/1025975658 learned_addr learned my addr 172.21.15.81:0/1025975658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc7400640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 -- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 msgr2=0x55b2f65a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 -- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 msgr2=0x55b2f65b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc6000640 1 -- 172.21.15.81:0/1025975658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f631c510 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.726+0000 7f9cc7400640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40125d0 tx=0x7f9cb4012a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc2b5d6f358017d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9ca7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4019070 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9cb4003c40 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc004c020 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9cb4024050 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9cd0c71740 10 client.5592 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.727+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b2f6220c20 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cc004c020 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9cb4027020 con 0x55b2f65bdba0 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 10 client.5592 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 10 client.5592 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 20 client.5592 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f65a8850 0x55b2f65d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 4 client.5592 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2f64f41b0 con 0x55b2f65a8850 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.728+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f65a8850 0x55b2f65d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.729+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f65a8850 0x55b2f65d2eb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327fe31c8a2ff2d6 server_cookie=270344e4f333c483 in_seq=0 out_seq=0 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.729+0000 7f9ca7e00640 10 client.5592 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1025975658 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2f64f41b0 con 0x55b2f65a8850 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9ca7e00640 10 client.5592 handle_command_reply: tid=0 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 client.5592 shutdown 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 msgr2=0x55b2f65a6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40125d0 tx=0x7f9cb4012a90 comp rx=0 tx=0).stop 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 shutdown_connections 2024-09-11T01:02:14.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f65a8850 0x55b2f65d2eb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65bdba0 0x55b2f65a6800 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1025975658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 >> 172.21.15.81:0/1025975658 conn(0x55b2f65797c0 msgr2=0x55b2f65ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9ca7e00640 0 client.5592 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 shutdown_connections 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1025975658 wait complete. 2024-09-11T01:02:14.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.730+0000 7f9cd0c71740 20 client.5592 trim_cache size 0 max 16384 2024-09-11T01:02:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.753+0000 7f9cd0c71740 1 Processor -- start 2024-09-11T01:02:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.753+0000 7f9cd0c71740 1 -- start start 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65bdba0 0x55b2f65e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81ff2e0 con 0x55b2f65800c0 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81fe1c0 con 0x55b2f65bdba0 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc81f4970 con 0x55b2f65b1690 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54042/0 (socket says 172.21.15.81:54042) 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.754+0000 7f9cc6a00640 1 -- 172.21.15.81:0/2873577860 learned_addr learned my addr 172.21.15.81:0/2873577860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 -- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 msgr2=0x55b2f65a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 -- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65bdba0 msgr2=0x55b2f65e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65bdba0 0x55b2f65e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 -- 172.21.15.81:0/2873577860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f6579380 con 0x55b2f65800c0 2024-09-11T01:02:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80099c0 tx=0x7f9cb803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8b2a13eac5ca22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cb2a00640 1 -- 172.21.15.81:0/2873577860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8035040 con 0x55b2f65800c0 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cb2a00640 1 -- 172.21.15.81:0/2873577860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cb8043040 con 0x55b2f65800c0 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.755+0000 7f9cb2a00640 1 -- 172.21.15.81:0/2873577860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8005440 con 0x55b2f65800c0 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 -- 172.21.15.81:0/2873577860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 msgr2=0x55b2f65a65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80099c0 tx=0x7f9cb803c000 comp rx=0 tx=0).stop 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 -- 172.21.15.81:0/2873577860 shutdown_connections 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65bdba0 0x55b2f65e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65b1690 0x55b2f65a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/2873577860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65800c0 0x55b2f65a65d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 -- 172.21.15.81:0/2873577860 >> 172.21.15.81:0/2873577860 conn(0x55b2f65797c0 msgr2=0x55b2f65b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 -- 172.21.15.81:0/2873577860 shutdown_connections 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.756+0000 7f9cd0c71740 1 -- 172.21.15.81:0/2873577860 wait complete. 2024-09-11T01:02:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.757+0000 7f9cd0c71740 1 -- start start 2024-09-11T01:02:14.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.757+0000 7f9cd0c71740 1 Processor -- start 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65bdba0 0x55b2f65bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81fce60 con 0x55b2f65b1690 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc81fdaf0 con 0x55b2f65800c0 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc81fd420 con 0x55b2f65bdba0 2024-09-11T01:02:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cd0c71740 10 client.0 _ll_register_callbacks cb 0x7f9cb4005450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54058/0 (socket says 172.21.15.81:54058) 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6000640 1 -- 172.21.15.81:0/1579244008 learned_addr learned my addr 172.21.15.81:0/1579244008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc7400640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65bdba0 0x55b2f65bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6000640 1 -- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65bdba0 msgr2=0x55b2f65bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.758+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65bdba0 0x55b2f65bb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cc6000640 1 -- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 msgr2=0x55b2f65cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cc6000640 1 -- 172.21.15.81:0/1579244008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f65b43d0 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cc6000640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001ef0 tx=0x7f9cb4004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8823d03fb08743 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9ca7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb402d060 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9cb4004630 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cb8043040 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9cb4033050 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cd0c71740 10 client.5598 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.759+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b2f65d0960 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cb8043040 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9cb4036020 con 0x55b2f65b1690 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 10 client.5598 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 10 client.5598 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 20 client.5598 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f663fc40 0x55b2f6640050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 4 client.5598 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}] 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}) -- 0x55b2f64efc60 con 0x55b2f663fc40 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.760+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f663fc40 0x55b2f6640050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.761+0000 7f9ca7e00640 10 client.5598 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.761+0000 7f9cc6a00640 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f663fc40 0x55b2f6640050 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed22bb2951d41be0 server_cookie=c2b84a8e976fd0ea in_seq=0 out_seq=0 2024-09-11T01:02:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.843+0000 7f9ca7e00640 1 -- 172.21.15.81:0/1579244008 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b2f64efc60 con 0x55b2f663fc40 2024-09-11T01:02:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.843+0000 7f9ca7e00640 10 client.5598 handle_command_reply: tid=0 2024-09-11T01:02:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.843+0000 7f9cd0c71740 1 client.5598 shutdown 2024-09-11T01:02:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 msgr2=0x55b2f657f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001ef0 tx=0x7f9cb4004120 comp rx=0 tx=0).stop 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 shutdown_connections 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b2f663fc40 0x55b2f6640050 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b2f65bdba0 0x55b2f65bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2f65b1690 0x55b2f657f1d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 --2- 172.21.15.81:0/1579244008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2f65800c0 0x55b2f65cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9ca7e00640 0 client.5598 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 >> 172.21.15.81:0/1579244008 conn(0x55b2f65797c0 msgr2=0x55b2f65806e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 shutdown_connections 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 1 -- 172.21.15.81:0/1579244008 wait complete. 2024-09-11T01:02:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.844+0000 7f9cd0c71740 20 client.5598 trim_cache size 0 max 16384 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 58, 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "f5b4b16d": { 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 58, 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:02:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 141.0, 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:02:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 msgr2=0x7f9ca807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 0x7f9ca807a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8033000 tx=0x7f9cb8004730 comp rx=0 tx=0).stop 2024-09-11T01:02:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 msgr2=0x7f9cc8156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000eaa0 tx=0x7f9cc000ef60 comp rx=0 tx=0).stop 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 shutdown_connections 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f9ca8077f70 0x7f9ca807a430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cc8154810 0x7f9cc8156e30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc80cc030 0x7f9cc81580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 --2- 172.21.15.81:0/3431156388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc80c5670 0x7f9cc80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 >> 172.21.15.81:0/3431156388 conn(0x7f9cc80688e0 msgr2=0x7f9cc80ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 shutdown_connections 2024-09-11T01:02:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:14.845+0000 7f9cc7e00640 1 -- 172.21.15.81:0/3431156388 wait complete. 2024-09-11T01:02:14.862 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f5b4b16d', quiesce took 0.8 seconds. Will release after: 20.2 2024-09-11T01:02:21.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:02:21.430 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:02:35.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 -- 172.21.15.81:0/1984774368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 msgr2=0x7fe0100c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 --2- 172.21.15.81:0/1984774368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 0x7fe0100c0f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe000009be0 tx=0x7fe00002a9b0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 -- 172.21.15.81:0/1984774368 shutdown_connections 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 --2- 172.21.15.81:0/1984774368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 0x7fe0100c0f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 -- 172.21.15.81:0/1984774368 >> 172.21.15.81:0/1984774368 conn(0x7fe0100700f0 msgr2=0x7fe010070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 -- 172.21.15.81:0/1984774368 shutdown_connections 2024-09-11T01:02:35.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.231+0000 7fe015600640 1 -- 172.21.15.81:0/1984774368 wait complete. 2024-09-11T01:02:35.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.233+0000 7fe015600640 1 Processor -- start 2024-09-11T01:02:35.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.233+0000 7fe015600640 1 -- start start 2024-09-11T01:02:35.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 0x7fe0101e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0101e3ed0 0x7fe0101f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe010070cf0 con 0x7fe010074860 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe01015c140 con 0x7fe0101e3ed0 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe015600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0100c8090 con 0x7fe010152610 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51624/0 (socket says 172.21.15.81:51624) 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 -- 172.21.15.81:0/1037242375 learned_addr learned my addr 172.21.15.81:0/1037242375 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 -- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 msgr2=0x7fe0101e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 0x7fe0101e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 -- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0101e3ed0 msgr2=0x7fe0101f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0101e3ed0 0x7fe0101f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.234+0000 7fe00ea00640 1 -- 172.21.15.81:0/1037242375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0101556f0 con 0x7fe010074860 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe00ea00640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe00002afa0 tx=0x7fe000030e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000044070 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe000004540 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000003e60 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe010155450 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.235+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101540f0 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.236+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01015c940 con 0x7fe010074860 2024-09-11T01:02:35.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.237+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe00003e030 con 0x7fe010074860 2024-09-11T01:02:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.239+0000 7fe006a00640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 0x7fdff007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.239+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe0000baa10 con 0x7fe010074860 2024-09-11T01:02:35.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.239+0000 7fe00e000640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 0x7fdff007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.240+0000 7fe00e000640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 0x7fdff007a460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe01014bdd0 tx=0x7fdffc0078f0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.243+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe00003c070 con 0x7fe010074860 2024-09-11T01:02:35.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.461+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0101f2170 con 0x7fe010074860 2024-09-11T01:02:35.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.461+0000 7fe006a00640 1 -- 172.21.15.81:0/1037242375 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fe000033020 con 0x7fe010074860 2024-09-11T01:02:35.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:02:35.463 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:02:35.463 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:02:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.463+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 msgr2=0x7fdff007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.463+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 0x7fdff007a460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe01014bdd0 tx=0x7fdffc0078f0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.463+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 msgr2=0x7fe01015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.463+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe00002afa0 tx=0x7fe000030e70 comp rx=0 tx=0).stop 2024-09-11T01:02:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 shutdown_connections 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdff0077fa0 0x7fdff007a460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0101e3ed0 0x7fe0101f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe010152610 0x7fe0101e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 --2- 172.21.15.81:0/1037242375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe010074860 0x7fe01015a8b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 >> 172.21.15.81:0/1037242375 conn(0x7fe0100700f0 msgr2=0x7fe0100c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 shutdown_connections 2024-09-11T01:02:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.464+0000 7fe015600640 1 -- 172.21.15.81:0/1037242375 wait complete. 2024-09-11T01:02:35.481 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id f5b4b16d --release --await' 2024-09-11T01:02:35.481 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id f5b4b16d --release --await 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 -- 172.21.15.81:0/826761798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c06f6b0 msgr2=0x7f2f1c0c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 --2- 172.21.15.81:0/826761798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c06f6b0 0x7f2f1c0c2160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f14005fd0 tx=0x7f2f1402aaa0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 -- 172.21.15.81:0/826761798 shutdown_connections 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 --2- 172.21.15.81:0/826761798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c06f6b0 0x7f2f1c0c2160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 --2- 172.21.15.81:0/826761798 >> v2:172.21.15.167:3300/0 conn(0x7f2f1c1515c0 0x7f2f1c0c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 -- 172.21.15.81:0/826761798 >> 172.21.15.81:0/826761798 conn(0x7f2f1c06ff90 msgr2=0x7f2f1c0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 -- 172.21.15.81:0/826761798 shutdown_connections 2024-09-11T01:02:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.643+0000 7f2f23600640 1 -- 172.21.15.81:0/826761798 wait complete. 2024-09-11T01:02:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.645+0000 7f2f23600640 1 Processor -- start 2024-09-11T01:02:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.645+0000 7f2f23600640 1 -- start start 2024-09-11T01:02:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 0x7f2f1c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c074c20 0x7f2f1c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c0c0eb0 con 0x7f2f1c1515c0 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c157f40 con 0x7f2f1c06f6b0 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f23600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c1519a0 con 0x7f2f1c074c20 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51632/0 (socket says 172.21.15.81:51632) 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 -- 172.21.15.81:0/37070604 learned_addr learned my addr 172.21.15.81:0/37070604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f20c00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 0x7f2f1c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f1be00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c074c20 0x7f2f1c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 -- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c074c20 msgr2=0x7f2f1c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c074c20 0x7f2f1c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 -- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 msgr2=0x7f2f1c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 0x7f2f1c073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f21600640 1 -- 172.21.15.81:0/37070604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c0c77d0 con 0x7f2f1c1515c0 2024-09-11T01:02:35.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.646+0000 7f2f20c00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 0x7f2f1c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f21600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2f14006010 tx=0x7f2f14003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f18c00640 1 -- 172.21.15.81:0/37070604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14046070 con 0x7f2f1c1515c0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f18c00640 1 -- 172.21.15.81:0/37070604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f14004040 con 0x7f2f1c1515c0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f18c00640 1 -- 172.21.15.81:0/37070604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14004430 con 0x7f2f1c1515c0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c1537c0 con 0x7f2f1c1515c0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.647+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c0c7a70 con 0x7f2f1c1515c0 2024-09-11T01:02:35.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.649+0000 7f2f18c00640 1 -- 172.21.15.81:0/37070604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f140045d0 con 0x7f2f1c1515c0 2024-09-11T01:02:35.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.650+0000 7f2f18c00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.650+0000 7f2f18c00640 1 -- 172.21.15.81:0/37070604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2f140bb2a0 con 0x7f2f1c1515c0 2024-09-11T01:02:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.651+0000 7f2f265f2740 1 Processor -- start 2024-09-11T01:02:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.651+0000 7f2f20c00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.651+0000 7f2f265f2740 1 -- start start 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009b80 tx=0x7f2f0c005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f177390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13c910 0x55579f1778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55579f0b4370 con 0x55579f13fb80 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55579f0a37a0 con 0x55579f13c910 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55579f0a75b0 con 0x55579f181810 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51640/0 (socket says 172.21.15.81:51640) 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 -- 172.21.15.81:0/2513017258 learned_addr learned my addr 172.21.15.81:0/2513017258 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f21600640 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13c910 0x55579f1778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f1be00640 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f177390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 -- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 msgr2=0x55579f177390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f177390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 -- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13c910 msgr2=0x55579f1778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13c910 0x55579f1778d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.652+0000 7f2f20c00640 1 -- 172.21.15.81:0/2513017258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579f03c010 con 0x55579f13fb80 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f20c00640 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c004030 tx=0x7f2f0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea2c50c65e63271 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f11200640 1 -- 172.21.15.81:0/2513017258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c003d70 con 0x55579f13fb80 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f11200640 1 -- 172.21.15.81:0/2513017258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f0c025070 con 0x55579f13fb80 2024-09-11T01:02:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f11200640 1 -- 172.21.15.81:0/2513017258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c012650 con 0x55579f13fb80 2024-09-11T01:02:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f265f2740 1 -- 172.21.15.81:0/2513017258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 msgr2=0x55579f18ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.653+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c004030 tx=0x7f2f0c014000 comp rx=0 tx=0).stop 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 -- 172.21.15.81:0/2513017258 shutdown_connections 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13c910 0x55579f1778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f177390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2513017258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f18ac20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 -- 172.21.15.81:0/2513017258 >> 172.21.15.81:0/2513017258 conn(0x55579f13dd60 msgr2=0x55579f13f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 -- 172.21.15.81:0/2513017258 shutdown_connections 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 -- 172.21.15.81:0/2513017258 wait complete. 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 -- start start 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.654+0000 7f2f265f2740 1 Processor -- start 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.655+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.655+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f17e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.655+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f1962d0 0x55579f175dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f265f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55579f04af70 con 0x55579f13fb80 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55579f049090 con 0x55579f1962d0 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55579f1893f0 con 0x55579f181810 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f265f2740 10 client.0 _ll_register_callbacks cb 0x55579edb2110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51654/0 (socket says 172.21.15.81:51654) 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 -- 172.21.15.81:0/4241993679 learned_addr learned my addr 172.21.15.81:0/4241993679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f1be00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f17e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f21600640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f1962d0 0x55579f175dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 -- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 msgr2=0x55579f17e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f17e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 -- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f1962d0 msgr2=0x55579f175dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f1962d0 0x55579f175dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 -- 172.21.15.81:0/4241993679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579ee05ea0 con 0x55579f13fb80 2024-09-11T01:02:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f20c00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0093f0 tx=0x7f2f0c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92888020353c5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.656+0000 7f2f05600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0129e0 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2f0c012b80 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0c025070 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c012d80 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 10 client.5613 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55579ee7ed30 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f0c025070 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2f0c03d050 con 0x55579f13fb80 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 10 client.5613 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 10 client.5613 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 20 client.5613 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f186010 0x55579f17fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 4 client.5613 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.657+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55579f0b62c0 con 0x55579f186010 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.658+0000 7f2f1be00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f186010 0x55579f17fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.658+0000 7f2f1be00640 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f186010 0x55579f17fe90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c499df119563a4 server_cookie=7ade58b84badd51c in_seq=0 out_seq=0 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.658+0000 7f2f05600640 10 client.5613 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.659+0000 7f2f05600640 1 -- 172.21.15.81:0/4241993679 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55579f0b62c0 con 0x55579f186010 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.659+0000 7f2f05600640 10 client.5613 handle_command_reply: tid=0 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.659+0000 7f2f265f2740 1 client.5613 shutdown 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 msgr2=0x55579f1889e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0093f0 tx=0x7f2f0c004620 comp rx=0 tx=0).stop 2024-09-11T01:02:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 shutdown_connections 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f186010 0x55579f17fe90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f1962d0 0x55579f175dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f181810 0x55579f17e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f05600640 0 client.5613 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 --2- 172.21.15.81:0/4241993679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f1889e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 >> 172.21.15.81:0/4241993679 conn(0x55579f13c910 msgr2=0x55579f13b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 shutdown_connections 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 1 -- 172.21.15.81:0/4241993679 wait complete. 2024-09-11T01:02:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.660+0000 7f2f265f2740 20 client.5613 trim_cache size 0 max 16384 2024-09-11T01:02:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 Processor -- start 2024-09-11T01:02:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 -- start start 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f177770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 0x55579f185140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c1ff4a0 con 0x55579f13fb80 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c1fe380 con 0x55579f181810 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.678+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c0cb9c0 con 0x55579f13c910 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51670/0 (socket says 172.21.15.81:51670) 2024-09-11T01:02:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 -- 172.21.15.81:0/2798758292 learned_addr learned my addr 172.21.15.81:0/2798758292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f20c00640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f177770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f21600640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 0x55579f185140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 -- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 msgr2=0x55579f177770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f177770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 -- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 msgr2=0x55579f185140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 0x55579f185140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 -- 172.21.15.81:0/2798758292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579f137850 con 0x55579f13fb80 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f20c00640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f177770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f21600640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 0x55579f185140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.679+0000 7f2f1be00640 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007ba0 tx=0x7f2f08009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985c815be0f1e06c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f07e00640 1 -- 172.21.15.81:0/2798758292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007550 con 0x55579f13fb80 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f07e00640 1 -- 172.21.15.81:0/2798758292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f080050d0 con 0x55579f13fb80 2024-09-11T01:02:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f07e00640 1 -- 172.21.15.81:0/2798758292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f080067d0 con 0x55579f13fb80 2024-09-11T01:02:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 -- 172.21.15.81:0/2798758292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 msgr2=0x55579f184c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007ba0 tx=0x7f2f08009040 comp rx=0 tx=0).stop 2024-09-11T01:02:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 -- 172.21.15.81:0/2798758292 shutdown_connections 2024-09-11T01:02:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f181810 0x55579f185140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f13fb80 0x55579f184c00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 --2- 172.21.15.81:0/2798758292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f177770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 -- 172.21.15.81:0/2798758292 >> 172.21.15.81:0/2798758292 conn(0x55579f188d30 msgr2=0x55579f17e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 -- 172.21.15.81:0/2798758292 shutdown_connections 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.680+0000 7f2f265f2740 1 -- 172.21.15.81:0/2798758292 wait complete. 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.681+0000 7f2f265f2740 1 -- start start 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.681+0000 7f2f265f2740 1 Processor -- start 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f1a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13fb80 0x55579f1a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c1fd0b0 con 0x55579f181810 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c1fdcf0 con 0x55579f13fb80 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c1fd6a0 con 0x55579f13c910 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f265f2740 10 client.0 _ll_register_callbacks cb 0x7f2f0c011f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f21600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f20c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f1a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f21600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51676/0 (socket says 172.21.15.81:51676) 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f21600640 1 -- 172.21.15.81:0/3663317033 learned_addr learned my addr 172.21.15.81:0/3663317033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.682+0000 7f2f1be00640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13fb80 0x55579f1a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 -- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 msgr2=0x55579f1a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f1a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 -- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13fb80 msgr2=0x55579f1a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13fb80 0x55579f1a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 -- 172.21.15.81:0/3663317033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579f189ff0 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f21600640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f14005fa0 tx=0x7f2f14004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d8feffb93a24ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f05600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a9030 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2f14081f70 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f080050d0 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2f1408c170 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f265f2740 10 client.5619 fetch_fsmap learned FSMap version 9 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55579f17fab0 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.683+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f080050d0 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2f14082170 con 0x55579f181810 2024-09-11T01:02:35.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 10 client.5619 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 10 client.5619 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 20 client.5619 populate_metadata read hostname 'smithi081' 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f1962d0 0x55579f1fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 4 client.5619 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f5b4b16d", "release": true, "await": true}] 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f5b4b16d", "release": true, "await": true}) -- 0x55579f0b1d70 con 0x55579f1962d0 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f20c00640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f1962d0 0x55579f1fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f20c00640 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f1962d0 0x55579f1fa790 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f36ba49e7270f3e server_cookie=ff979456f2bd3e75 in_seq=0 out_seq=0 2024-09-11T01:02:35.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.684+0000 7f2f05600640 10 client.5619 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:35.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.704+0000 7f2f05600640 1 -- 172.21.15.81:0/3663317033 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55579f0b1d70 con 0x55579f1962d0 2024-09-11T01:02:35.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.704+0000 7f2f05600640 10 client.5619 handle_command_reply: tid=0 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.704+0000 7f2f265f2740 1 client.5619 shutdown 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 msgr2=0x55579f1fa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2f14005fa0 tx=0x7f2f14004970 comp rx=0 tx=0).stop 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 shutdown_connections 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55579f1962d0 0x55579f1fa790 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55579f181810 0x55579f1fa250 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55579f13fb80 0x55579f1a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 --2- 172.21.15.81:0/3663317033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55579f13c910 0x55579f1a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 >> 172.21.15.81:0/3663317033 conn(0x55579f188d30 msgr2=0x55579f192d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f05600640 0 client.5619 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 shutdown_connections 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 1 -- 172.21.15.81:0/3663317033 wait complete. 2024-09-11T01:02:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.705+0000 7f2f265f2740 20 client.5619 trim_cache size 0 max 16384 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 60, 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "f5b4b16d": { 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 60, 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:02:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 141.0, 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:02:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:02:35.710 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 msgr2=0x7f2efc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009b80 tx=0x7f2f0c005f90 comp rx=0 tx=0).stop 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 msgr2=0x7f2f1c0c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2f14006010 tx=0x7f2f14003ce0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 shutdown_connections 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c1515c0 0x7f2f1c0c6f90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f1c074c20 0x7f2f1c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 --2- 172.21.15.81:0/37070604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f1c06f6b0 0x7f2f1c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 >> 172.21.15.81:0/37070604 conn(0x7f2f1c06ff90 msgr2=0x7f2f1c14e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 shutdown_connections 2024-09-11T01:02:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:02:35.706+0000 7f2f23600640 1 -- 172.21.15.81:0/37070604 wait complete. 2024-09-11T01:02:35.724 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f5b4b16d', total seconds elapsed: 21.7 2024-09-11T01:02:51.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:02:51.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:03:21.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:03:21.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:03:51.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:03:51.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:03:53.725 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:03:53.725 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:03:53.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.035+0000 7ff7bdc00640 1 -- 172.21.15.81:0/537953678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8152610 msgr2=0x7ff7b80c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.035+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/537953678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8152610 0x7ff7b80c0f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009860 tx=0x7ff7a802a620 comp rx=0 tx=0).stop 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.035+0000 7ff7bdc00640 1 -- 172.21.15.81:0/537953678 shutdown_connections 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.035+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/537953678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8152610 0x7ff7b80c0f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.035+0000 7ff7bdc00640 1 -- 172.21.15.81:0/537953678 >> 172.21.15.81:0/537953678 conn(0x7ff7b80700f0 msgr2=0x7ff7b8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.036+0000 7ff7bdc00640 1 -- 172.21.15.81:0/537953678 shutdown_connections 2024-09-11T01:03:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.036+0000 7ff7bdc00640 1 -- 172.21.15.81:0/537953678 wait complete. 2024-09-11T01:03:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.037+0000 7ff7bdc00640 1 Processor -- start 2024-09-11T01:03:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.037+0000 7ff7bdc00640 1 -- start start 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8074860 0x7ff7b81f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b8152610 0x7ff7b81f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8070cf0 con 0x7ff7b815a350 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b815c140 con 0x7ff7b8152610 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.038+0000 7ff7bdc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b80c8090 con 0x7ff7b8074860 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49446/0 (socket says 172.21.15.81:49446) 2024-09-11T01:03:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 -- 172.21.15.81:0/790969703 learned_addr learned my addr 172.21.15.81:0/790969703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b6a00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8074860 0x7ff7b81f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b6000640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b8152610 0x7ff7b81f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 -- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8074860 msgr2=0x7ff7b81f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8074860 0x7ff7b81f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 -- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b8152610 msgr2=0x7ff7b81f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b8152610 0x7ff7b81f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 -- 172.21.15.81:0/790969703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b8153860 con 0x7ff7b815a350 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.039+0000 7ff7b7400640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c7a0 tx=0x7ff7b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.040+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003b70 con 0x7ff7b815a350 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.040+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7b0003d10 con 0x7ff7b815a350 2024-09-11T01:03:54.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.040+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b8159850 con 0x7ff7b815a350 2024-09-11T01:03:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.040+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000aab0 con 0x7ff7b815a350 2024-09-11T01:03:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.040+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b8159e10 con 0x7ff7b815a350 2024-09-11T01:03:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.041+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b81529f0 con 0x7ff7b815a350 2024-09-11T01:03:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.042+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff7b000ac50 con 0x7ff7b815a350 2024-09-11T01:03:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.043+0000 7ff7aea00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 0x7ff79807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.043+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff7b0099e30 con 0x7ff7b815a350 2024-09-11T01:03:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.044+0000 7ff7b6a00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 0x7ff79807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.044+0000 7ff7b6a00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 0x7ff79807a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a8004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.048+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff7b0061ee0 con 0x7ff7b815a350 2024-09-11T01:03:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.305+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7b814c690 con 0x7ff7b815a350 2024-09-11T01:03:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.306+0000 7ff7aea00640 1 -- 172.21.15.81:0/790969703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7ff7b0066910 con 0x7ff7b815a350 2024-09-11T01:03:54.308 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:03:54.309 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:03:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 msgr2=0x7ff79807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 0x7ff79807a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a8004730 comp rx=0 tx=0).stop 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 msgr2=0x7ff7b8155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c7a0 tx=0x7ff7b000cc60 comp rx=0 tx=0).stop 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 shutdown_connections 2024-09-11T01:03:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff798077f70 0x7ff79807a430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7b815a350 0x7ff7b8155420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b8152610 0x7ff7b81f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 --2- 172.21.15.81:0/790969703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b8074860 0x7ff7b81f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.308+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 >> 172.21.15.81:0/790969703 conn(0x7ff7b80700f0 msgr2=0x7ff7b8151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.309+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 shutdown_connections 2024-09-11T01:03:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.309+0000 7ff7bdc00640 1 -- 172.21.15.81:0/790969703 wait complete. 2024-09-11T01:03:54.339 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:03:54.339 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 -- 172.21.15.81:0/754176620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a4154810 msgr2=0x7f27a40cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 --2- 172.21.15.81:0/754176620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a4154810 0x7f27a40cadf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2790009830 tx=0x7f279002a5a0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 -- 172.21.15.81:0/754176620 shutdown_connections 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 --2- 172.21.15.81:0/754176620 >> v2:172.21.15.167:3300/0 conn(0x7f27a40c5670 0x7f27a40cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 --2- 172.21.15.81:0/754176620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a4154810 0x7f27a40cadf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 -- 172.21.15.81:0/754176620 >> 172.21.15.81:0/754176620 conn(0x7f27a40688e0 msgr2=0x7f27a4068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 -- 172.21.15.81:0/754176620 shutdown_connections 2024-09-11T01:03:54.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.656+0000 7f27a3200640 1 -- 172.21.15.81:0/754176620 wait complete. 2024-09-11T01:03:54.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.658+0000 7f27a3200640 1 Processor -- start 2024-09-11T01:03:54.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.658+0000 7f27a3200640 1 -- start start 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.659+0000 7f27a3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a40c5670 0x7f27a4157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.659+0000 7f27a3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a4154810 0x7f27a40c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a415a500 con 0x7f27a4154810 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27a415b0b0 con 0x7f27a40c5670 2024-09-11T01:03:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27a40c5e20 con 0x7f27a40cc030 2024-09-11T01:03:54.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:35490/0 (socket says 172.21.15.81:35490) 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a4154810 0x7f27a40c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 -- 172.21.15.81:0/791533761 learned_addr learned my addr 172.21.15.81:0/791533761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1e00640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a40c5670 0x7f27a4157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 -- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a40c5670 msgr2=0x7f27a4157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a40c5670 0x7f27a4157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 -- 172.21.15.81:0/791533761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a4154810 msgr2=0x7f27a40c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a4154810 0x7f27a40c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.660+0000 7f27a1400640 1 -- 172.21.15.81:0/791533761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a40cff80 con 0x7f27a40cc030 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f27a1400640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f279400c430 tx=0x7f279400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f279a000640 1 -- 172.21.15.81:0/791533761 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794017070 con 0x7f27a40cc030 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f279a000640 1 -- 172.21.15.81:0/791533761 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27940053c0 con 0x7f27a40cc030 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a41f18f0 con 0x7f27a40cc030 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f279a000640 1 -- 172.21.15.81:0/791533761 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27940038a0 con 0x7f27a40cc030 2024-09-11T01:03:54.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.661+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a40cf3f0 con 0x7f27a40cc030 2024-09-11T01:03:54.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.664+0000 7f279a000640 1 -- 172.21.15.81:0/791533761 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2794003a40 con 0x7f27a40cc030 2024-09-11T01:03:54.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.665+0000 7f279a000640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 0x7f278407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.665+0000 7f279a000640 1 -- 172.21.15.81:0/791533761 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2794099710 con 0x7f27a40cc030 2024-09-11T01:03:54.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.665+0000 7f27a1e00640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 0x7f278407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.666+0000 7f27a1e00640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 0x7f278407a460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2790034000 tx=0x7f2790004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.690+0000 7f27abded740 1 Processor -- start 2024-09-11T01:03:54.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.691+0000 7f27abded740 1 -- start start 2024-09-11T01:03:54.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.691+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c2187c0 0x558e1c218ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c21f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27abded740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27abded740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e1c191260 con 0x558e1c25cba0 2024-09-11T01:03:54.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e1c180690 con 0x558e1c2187c0 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x558e1c1844a0 con 0x558e1c21f0c0 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49464/0 (socket says 172.21.15.81:49464) 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 -- 172.21.15.81:0/978317734 learned_addr learned my addr 172.21.15.81:0/978317734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a1e00640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c2187c0 0x558e1c218ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a1400640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c21f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 -- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 msgr2=0x558e1c21f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c21f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 -- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c2187c0 msgr2=0x558e1c218ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c2187c0 0x558e1c218ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a2800640 1 -- 172.21.15.81:0/978317734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e1bf5ad80 con 0x558e1c25cba0 2024-09-11T01:03:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.692+0000 7f27a1400640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c21f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.693+0000 7f27a2800640 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f279c009a30 tx=0x7f279c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28afe1bbc399305 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.693+0000 7f278ea00640 1 -- 172.21.15.81:0/978317734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c003970 con 0x558e1c25cba0 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.693+0000 7f278ea00640 1 -- 172.21.15.81:0/978317734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279c003b10 con 0x558e1c25cba0 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.693+0000 7f278ea00640 1 -- 172.21.15.81:0/978317734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c00d770 con 0x558e1c25cba0 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 -- 172.21.15.81:0/978317734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 msgr2=0x558e1c253d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f279c009a30 tx=0x7f279c0095c0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 -- 172.21.15.81:0/978317734 shutdown_connections 2024-09-11T01:03:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c253d10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c21f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 --2- 172.21.15.81:0/978317734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c2187c0 0x558e1c218ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 -- 172.21.15.81:0/978317734 >> 172.21.15.81:0/978317734 conn(0x558e1c21a520 msgr2=0x558e1c21ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 -- 172.21.15.81:0/978317734 shutdown_connections 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.694+0000 7f27abded740 1 -- 172.21.15.81:0/978317734 wait complete. 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.695+0000 7f27abded740 1 -- start start 2024-09-11T01:03:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.695+0000 7f27abded740 1 Processor -- start 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c250c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25bd70 0x558e1c252b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e1bef0cc0 con 0x558e1c25cba0 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e1c125e60 con 0x558e1c25bd70 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x558e1c21e500 con 0x558e1c21f0c0 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27abded740 10 client.0 _ll_register_callbacks cb 0x558e1c12c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49480/0 (socket says 172.21.15.81:49480) 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27a1400640 1 -- 172.21.15.81:0/2419872720 learned_addr learned my addr 172.21.15.81:0/2419872720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27a1e00640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c250c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.696+0000 7f27a2800640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25bd70 0x558e1c252b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 -- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 msgr2=0x558e1c250c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c250c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 -- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25bd70 msgr2=0x558e1c252b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25bd70 0x558e1c252b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 -- 172.21.15.81:0/2419872720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e1bfbb510 con 0x558e1c25cba0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27a1400640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f279400cdf0 tx=0x7f2794061420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16821279910ddc5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f2783400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279406aca0 con 0x558e1c25cba0 2024-09-11T01:03:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f279405d1a0 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279c003b10 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.697+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f279405d3a0 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 10 client.5634 fetch_fsmap learned FSMap version 9 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558e1bebfc20 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279c003b10 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f279407b0c0 con 0x558e1c25cba0 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 10 client.5634 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 10 client.5634 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 20 client.5634 populate_metadata read hostname 'smithi081' 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c246870 0x558e1c246ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 4 client.5634 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:03:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e1c1931b0 con 0x558e1c246870 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.698+0000 7f27a1e00640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c246870 0x558e1c246ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.699+0000 7f2783400640 10 client.5634 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.699+0000 7f27a1e00640 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c246870 0x558e1c246ca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d5084a50d2f092 server_cookie=be6adb84b93b53f5 in_seq=0 out_seq=0 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f2783400640 1 -- 172.21.15.81:0/2419872720 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e1c1931b0 con 0x558e1c246870 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f2783400640 10 client.5634 handle_command_reply: tid=0 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 client.5634 shutdown 2024-09-11T01:03:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 msgr2=0x558e1c249120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f279400cdf0 tx=0x7f2794061420 comp rx=0 tx=0).stop 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 shutdown_connections 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c246870 0x558e1c246ca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25bd70 0x558e1c252b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25cba0 0x558e1c249120 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 --2- 172.21.15.81:0/2419872720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c250c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 >> 172.21.15.81:0/2419872720 conn(0x558e1c2187c0 msgr2=0x558e1c24fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f2783400640 0 client.5634 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:03:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.700+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 shutdown_connections 2024-09-11T01:03:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.701+0000 7f27abded740 1 -- 172.21.15.81:0/2419872720 wait complete. 2024-09-11T01:03:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.701+0000 7f27abded740 20 client.5634 trim_cache size 0 max 16384 2024-09-11T01:03:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.724+0000 7f27abded740 1 Processor -- start 2024-09-11T01:03:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.724+0000 7f27abded740 1 -- start start 2024-09-11T01:03:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c219be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25cba0 0x558e1c2830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ff280 con 0x558e1c25bd70 2024-09-11T01:03:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41fe160 con 0x558e1c25cba0 2024-09-11T01:03:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27a41f4a30 con 0x558e1c21f0c0 2024-09-11T01:03:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49490/0 (socket says 172.21.15.81:49490) 2024-09-11T01:03:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 -- 172.21.15.81:0/3673309873 learned_addr learned my addr 172.21.15.81:0/3673309873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1e00640 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c219be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a2800640 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25cba0 0x558e1c2830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 -- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 msgr2=0x558e1c219be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c219be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 -- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25cba0 msgr2=0x558e1c2830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25cba0 0x558e1c2830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.725+0000 7f27a1400640 1 -- 172.21.15.81:0/3673309873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e1c25c1b0 con 0x558e1c25bd70 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.726+0000 7f27a1400640 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2794001000 tx=0x7f279405df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1e49e74c959f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.726+0000 7f278e000640 1 -- 172.21.15.81:0/3673309873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794001170 con 0x558e1c25bd70 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.726+0000 7f278e000640 1 -- 172.21.15.81:0/3673309873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279405dac0 con 0x558e1c25bd70 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.726+0000 7f278e000640 1 -- 172.21.15.81:0/3673309873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279407b110 con 0x558e1c25bd70 2024-09-11T01:03:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 -- 172.21.15.81:0/3673309873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 msgr2=0x558e1c282bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2794001000 tx=0x7f279405df20 comp rx=0 tx=0).stop 2024-09-11T01:03:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 -- 172.21.15.81:0/3673309873 shutdown_connections 2024-09-11T01:03:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c25cba0 0x558e1c2830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c282bb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 --2- 172.21.15.81:0/3673309873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c21f0c0 0x558e1c219be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 -- 172.21.15.81:0/3673309873 >> 172.21.15.81:0/3673309873 conn(0x558e1c2187c0 msgr2=0x558e1c24fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 -- 172.21.15.81:0/3673309873 shutdown_connections 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.727+0000 7f27abded740 1 -- 172.21.15.81:0/3673309873 wait complete. 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.728+0000 7f27abded740 1 -- start start 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.728+0000 7f27abded740 1 Processor -- start 2024-09-11T01:03:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c21f0c0 0x558e1c2e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c25cba0 0x558e1c282e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41fcfd0 con 0x558e1c25bd70 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41fda90 con 0x558e1c21f0c0 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27a41fd3e0 con 0x558e1c25cba0 2024-09-11T01:03:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27abded740 10 client.0 _ll_register_callbacks cb 0x7f2794061000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:03:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49496/0 (socket says 172.21.15.81:49496) 2024-09-11T01:03:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 -- 172.21.15.81:0/3434150505 learned_addr learned my addr 172.21.15.81:0/3434150505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:03:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a2800640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c25cba0 0x558e1c282e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1e00640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c21f0c0 0x558e1c2e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 -- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c25cba0 msgr2=0x558e1c282e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c25cba0 0x558e1c282e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 -- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c21f0c0 msgr2=0x558e1c2e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:03:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c21f0c0 0x558e1c2e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.729+0000 7f27a1400640 1 -- 172.21.15.81:0/3434150505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e1c2e0b50 con 0x558e1c25bd70 2024-09-11T01:03:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f27a1400640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f279405eac0 tx=0x7f2794000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e1e2b0c84c7557 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f2783400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:03:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794001170 con 0x558e1c25bd70 2024-09-11T01:03:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2794062ad0 con 0x558e1c25bd70 2024-09-11T01:03:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279405dac0 con 0x558e1c25bd70 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2794062cd0 con 0x558e1c25bd70 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f27abded740 10 client.5640 fetch_fsmap learned FSMap version 9 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558e1c2525b0 con 0x558e1c25bd70 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.730+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279405dac0 con 0x558e1c25bd70 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2794097020 con 0x558e1c25bd70 2024-09-11T01:03:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 10 client.5640 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 10 client.5640 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 20 client.5640 populate_metadata read hostname 'smithi081' 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c2833b0 0x558e1c2e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 4 client.5640 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x558e1c18ec60 con 0x558e1c2833b0 2024-09-11T01:03:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.731+0000 7f27a1e00640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c2833b0 0x558e1c2e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.732+0000 7f27a1e00640 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c2833b0 0x558e1c2e3b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3122299eb22e6c server_cookie=92e485ac66784b95 in_seq=0 out_seq=0 2024-09-11T01:03:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.732+0000 7f2783400640 10 client.5640 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:03:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f2783400640 1 -- 172.21.15.81:0/3434150505 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558e1c18ec60 con 0x558e1c2833b0 2024-09-11T01:03:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f2783400640 10 client.5640 handle_command_reply: tid=0 2024-09-11T01:03:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 client.5640 shutdown 2024-09-11T01:03:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 msgr2=0x558e1c2d6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f279405eac0 tx=0x7f2794000bc0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 shutdown_connections 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x558e1c2833b0 0x558e1c2e3b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e1c25cba0 0x558e1c282e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e1c25bd70 0x558e1c2d6d60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f2783400640 0 client.5640 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 --2- 172.21.15.81:0/3434150505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e1c21f0c0 0x558e1c2e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.819+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 >> 172.21.15.81:0/3434150505 conn(0x558e1c2187c0 msgr2=0x558e1c219be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 shutdown_connections 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27abded740 1 -- 172.21.15.81:0/3434150505 wait complete. 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27abded740 20 client.5640 trim_cache size 0 max 16384 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:03:54.825 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 62, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "b423c791": { 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 62, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:03:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:03:54.827 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:03:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 msgr2=0x7f278407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 0x7f278407a460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2790034000 tx=0x7f2790004730 comp rx=0 tx=0).stop 2024-09-11T01:03:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 msgr2=0x7f27a40c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.820+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f279400c430 tx=0x7f279400c8f0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 shutdown_connections 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2784077fa0 0x7f278407a460 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a4154810 0x7f27a40c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27a40cc030 0x7f27a40c7710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 --2- 172.21.15.81:0/791533761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27a40c5670 0x7f27a4157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 >> 172.21.15.81:0/791533761 conn(0x7f27a40688e0 msgr2=0x7f27a4150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 shutdown_connections 2024-09-11T01:03:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:03:54.821+0000 7f27a3200640 1 -- 172.21.15.81:0/791533761 wait complete. 2024-09-11T01:03:54.838 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b423c791', quiesce took 1.1 seconds. Will release after: 28.9 2024-09-11T01:04:21.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:04:21.950 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:04:23.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:04:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 -- 172.21.15.81:0/3839495137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8348074860 msgr2=0x7f83480c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 --2- 172.21.15.81:0/3839495137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8348074860 0x7f83480c7980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8348074fb0 tx=0x7f833402a670 comp rx=0 tx=0).stop 2024-09-11T01:04:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 -- 172.21.15.81:0/3839495137 shutdown_connections 2024-09-11T01:04:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 --2- 172.21.15.81:0/3839495137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83480c8680 0x7f83480c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 --2- 172.21.15.81:0/3839495137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8348074860 0x7f83480c7980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 -- 172.21.15.81:0/3839495137 >> 172.21.15.81:0/3839495137 conn(0x7f83480700f0 msgr2=0x7f8348070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 -- 172.21.15.81:0/3839495137 shutdown_connections 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.906+0000 7f834dc00640 1 -- 172.21.15.81:0/3839495137 wait complete. 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.908+0000 7f834dc00640 1 Processor -- start 2024-09-11T01:04:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.908+0000 7f834dc00640 1 -- start start 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 0x7f8348153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 0x7f8348154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8348070cf0 con 0x7f8348074860 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f834815c140 con 0x7f83480c6020 2024-09-11T01:04:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f834dc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f83480c16a0 con 0x7f8348152610 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f8346a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f8346a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41108/0 (socket says 172.21.15.81:41108) 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.909+0000 7f8346a00640 1 -- 172.21.15.81:0/30721192 learned_addr learned my addr 172.21.15.81:0/30721192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8347400640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 0x7f8348154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346000640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 0x7f8348153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 -- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 msgr2=0x7f8348153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 0x7f8348153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 -- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 msgr2=0x7f8348154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 0x7f8348154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 -- 172.21.15.81:0/30721192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83481f5160 con 0x7f8348074860 2024-09-11T01:04:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346000640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 0x7f8348153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:04:23.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8347400640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 0x7f8348154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:04:23.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f8346a00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f833800c480 tx=0x7f833800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380052d0 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8338005470 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834814cc90 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338012870 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.910+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834814cf30 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.912+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8348075080 con 0x7f8348074860 2024-09-11T01:04:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.912+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f83380035f0 con 0x7f8348074860 2024-09-11T01:04:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.913+0000 7f833ea00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 0x7f832807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.913+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8338099dd0 con 0x7f8348074860 2024-09-11T01:04:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.914+0000 7f8346000640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 0x7f832807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.914+0000 7f8346000640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 0x7f832807a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8334033000 tx=0x7f8334004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:23.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:23.917+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8348075080 con 0x7f8348074860 2024-09-11T01:04:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.137+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83481529f0 con 0x7f8348074860 2024-09-11T01:04:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.138+0000 7f833ea00640 1 -- 172.21.15.81:0/30721192 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f83380624d0 con 0x7f8348074860 2024-09-11T01:04:24.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:04:24.139 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:04:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:04:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 msgr2=0x7f832807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 0x7f832807a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8334033000 tx=0x7f8334004730 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 msgr2=0x7f8348153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f833800c480 tx=0x7f833800c940 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 shutdown_connections 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8328077f70 0x7f832807a430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83480c6020 0x7f8348154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8348152610 0x7f8348153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 --2- 172.21.15.81:0/30721192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8348074860 0x7f8348153050 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 >> 172.21.15.81:0/30721192 conn(0x7f83480700f0 msgr2=0x7f834814e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 shutdown_connections 2024-09-11T01:04:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.140+0000 7f834dc00640 1 -- 172.21.15.81:0/30721192 wait complete. 2024-09-11T01:04:24.158 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id b423c791 --release --await' 2024-09-11T01:04:24.158 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id b423c791 --release --await 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 -- 172.21.15.81:0/2881525058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 msgr2=0x7f525c070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 --2- 172.21.15.81:0/2881525058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c070c40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f525c0ccee0 tx=0x7f524802a540 comp rx=0 tx=0).stop 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 -- 172.21.15.81:0/2881525058 shutdown_connections 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 --2- 172.21.15.81:0/2881525058 >> v2:172.21.15.167:3300/0 conn(0x7f525c0725a0 0x7f525c0729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 --2- 172.21.15.81:0/2881525058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c070c40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 -- 172.21.15.81:0/2881525058 >> 172.21.15.81:0/2881525058 conn(0x7f525c06ff90 msgr2=0x7f525c0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 -- 172.21.15.81:0/2881525058 shutdown_connections 2024-09-11T01:04:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.321+0000 7f5262800640 1 -- 172.21.15.81:0/2881525058 wait complete. 2024-09-11T01:04:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.323+0000 7f5262800640 1 Processor -- start 2024-09-11T01:04:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.323+0000 7f5262800640 1 -- start start 2024-09-11T01:04:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 0x7f525c0aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f525c0725a0 0x7f525c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c074db0 con 0x7f525c0c7a70 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0c6bf0 con 0x7f525c06f760 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f5262800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0c6e40 con 0x7f525c0725a0 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41124/0 (socket says 172.21.15.81:41124) 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 -- 172.21.15.81:0/1280621480 learned_addr learned my addr 172.21.15.81:0/1280621480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525b400640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 0x7f525c0aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525aa00640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f525c0725a0 0x7f525c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 -- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f525c0725a0 msgr2=0x7f525c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f525c0725a0 0x7f525c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 -- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 msgr2=0x7f525c0aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 0x7f525c0aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525be00640 1 -- 172.21.15.81:0/1280621480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c152510 con 0x7f525c0c7a70 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.324+0000 7f525b400640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 0x7f525c0aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f525be00640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f525400d770 tx=0x7f525400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f5253400640 1 -- 172.21.15.81:0/1280621480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254017070 con 0x7f525c0c7a70 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f5253400640 1 -- 172.21.15.81:0/1280621480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5254009d20 con 0x7f525c0c7a70 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f5253400640 1 -- 172.21.15.81:0/1280621480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254004280 con 0x7f525c0c7a70 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c14f670 con 0x7f525c0c7a70 2024-09-11T01:04:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.325+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1ef850 con 0x7f525c0c7a70 2024-09-11T01:04:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.327+0000 7f5253400640 1 -- 172.21.15.81:0/1280621480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52540035f0 con 0x7f525c0c7a70 2024-09-11T01:04:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.329+0000 7f5253400640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 0x7f523c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.329+0000 7f5253400640 1 -- 172.21.15.81:0/1280621480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f525409a360 con 0x7f525c0c7a70 2024-09-11T01:04:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.329+0000 7f52656b2740 1 Processor -- start 2024-09-11T01:04:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.329+0000 7f525b400640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 0x7f523c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.329+0000 7f52656b2740 1 -- start start 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f525b400640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 0x7f523c07a460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f524c001770 tx=0x7f524c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f65970 0x55a625f69a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a625edd370 con 0x55a625f68570 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a625ecc7a0 con 0x55a625f65970 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a625ed05b0 con 0x55a625f68190 2024-09-11T01:04:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f525b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f525aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f65970 0x55a625f69a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60374/0 (socket says 172.21.15.81:60374) 2024-09-11T01:04:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.330+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41138/0 (socket says 172.21.15.81:41138) 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525b400640 1 -- 172.21.15.81:0/506704646 learned_addr learned my addr 172.21.15.81:0/506704646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 -- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 msgr2=0x55a625f694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 -- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f65970 msgr2=0x55a625f69a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f65970 0x55a625f69a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 -- 172.21.15.81:0/506704646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a625e65010 con 0x55a625f68570 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525b400640 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f525be00640 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5254098450 tx=0x7f525400df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5407658619264 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f5247e00640 1 -- 172.21.15.81:0/506704646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254020040 con 0x55a625f68570 2024-09-11T01:04:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f5247e00640 1 -- 172.21.15.81:0/506704646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f525406b1a0 con 0x55a625f68570 2024-09-11T01:04:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.331+0000 7f5247e00640 1 -- 172.21.15.81:0/506704646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540622c0 con 0x55a625f68570 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 -- 172.21.15.81:0/506704646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 msgr2=0x55a625fb6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5254098450 tx=0x7f525400df40 comp rx=0 tx=0).stop 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 -- 172.21.15.81:0/506704646 shutdown_connections 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fb6bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f65970 0x55a625f69a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 --2- 172.21.15.81:0/506704646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625f694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 -- 172.21.15.81:0/506704646 >> 172.21.15.81:0/506704646 conn(0x55a625f66370 msgr2=0x55a625f67850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 -- 172.21.15.81:0/506704646 shutdown_connections 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.332+0000 7f52656b2740 1 -- 172.21.15.81:0/506704646 wait complete. 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.333+0000 7f52656b2740 1 -- start start 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.333+0000 7f52656b2740 1 Processor -- start 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625fb8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625fa45d0 0x55a625fa68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a625e73f70 con 0x55a625f68570 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a625e72090 con 0x55a625f68190 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55a625f68fd0 con 0x55a625fa45d0 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f52656b2740 10 client.0 _ll_register_callbacks cb 0x55a625bdb110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41146/0 (socket says 172.21.15.81:41146) 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 -- 172.21.15.81:0/1021517323 learned_addr learned my addr 172.21.15.81:0/1021517323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525b400640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625fb8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 -- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625fa45d0 msgr2=0x55a625fa68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625fa45d0 0x55a625fa68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.334+0000 7f525aa00640 1 -- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 msgr2=0x55a625fb8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f525aa00640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625fb8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f525aa00640 1 -- 172.21.15.81:0/1021517323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a625c2eea0 con 0x55a625f68570 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f525aa00640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52480098f0 tx=0x7f5248004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2354cd649b9e7417 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f5244c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248003de0 con 0x55a625f68570 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f5248005020 con 0x55a625f68570 2024-09-11T01:04:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525406b1a0 con 0x55a625f68570 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f5248009450 con 0x55a625f68570 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f52656b2740 10 client.5658 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a625ca7d30 con 0x55a625f68570 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.335+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f525406b1a0 con 0x55a625f68570 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f524804c050 con 0x55a625f68570 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 10 client.5658 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 10 client.5658 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 20 client.5658 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f96240 0x55a625fc1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 4 client.5658 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:04:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a625edf2c0 con 0x55a625f96240 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.336+0000 7f525b400640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f96240 0x55a625fc1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.337+0000 7f525b400640 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f96240 0x55a625fc1ca0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a355bb9e15ccca67 server_cookie=8d55bf83bbcc0307 in_seq=0 out_seq=0 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.337+0000 7f5244c00640 10 client.5658 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f5244c00640 1 -- 172.21.15.81:0/1021517323 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a625edf2c0 con 0x55a625f96240 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f5244c00640 10 client.5658 handle_command_reply: tid=0 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 client.5658 shutdown 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 msgr2=0x55a625fbf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52480098f0 tx=0x7f5248004610 comp rx=0 tx=0).stop 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 shutdown_connections 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f96240 0x55a625fc1ca0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625fa45d0 0x55a625fa68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625fbf160 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f5244c00640 0 client.5658 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 --2- 172.21.15.81:0/1021517323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625fb8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 >> 172.21.15.81:0/1021517323 conn(0x55a625f65970 msgr2=0x55a625f6b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 shutdown_connections 2024-09-11T01:04:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 1 -- 172.21.15.81:0/1021517323 wait complete. 2024-09-11T01:04:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.338+0000 7f52656b2740 20 client.5658 trim_cache size 0 max 16384 2024-09-11T01:04:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.356+0000 7f52656b2740 1 Processor -- start 2024-09-11T01:04:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.356+0000 7f52656b2740 1 -- start start 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625fa6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625fa45d0 0x55a625f9bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1fafc0 con 0x55a625f68570 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1f9ea0 con 0x55a625fa45d0 2024-09-11T01:04:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f525c1f2e90 con 0x55a625f68190 2024-09-11T01:04:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41150/0 (socket says 172.21.15.81:41150) 2024-09-11T01:04:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 -- 172.21.15.81:0/2470365628 learned_addr learned my addr 172.21.15.81:0/2470365628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525b400640 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625fa6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525be00640 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625fa45d0 0x55a625f9bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 -- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 msgr2=0x55a625fa6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625fa6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 -- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625fa45d0 msgr2=0x55a625f9bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625fa45d0 0x55a625f9bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.357+0000 7f525aa00640 1 -- 172.21.15.81:0/2470365628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a625f679c0 con 0x55a625f68570 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.358+0000 7f525aa00640 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34657917127dbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.358+0000 7f5247400640 1 -- 172.21.15.81:0/2470365628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248003de0 con 0x55a625f68570 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.358+0000 7f5247400640 1 -- 172.21.15.81:0/2470365628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52480035f0 con 0x55a625f68570 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.358+0000 7f5247400640 1 -- 172.21.15.81:0/2470365628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524804e470 con 0x55a625f68570 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- 172.21.15.81:0/2470365628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 msgr2=0x55a625f9fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248004460 comp rx=0 tx=0).stop 2024-09-11T01:04:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- 172.21.15.81:0/2470365628 shutdown_connections 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625fa45d0 0x55a625f9bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625f68570 0x55a625f9fb90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 --2- 172.21.15.81:0/2470365628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68190 0x55a625fa6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- 172.21.15.81:0/2470365628 >> 172.21.15.81:0/2470365628 conn(0x55a625f65970 msgr2=0x55a625fa05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- 172.21.15.81:0/2470365628 shutdown_connections 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- 172.21.15.81:0/2470365628 wait complete. 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.359+0000 7f52656b2740 1 -- start start 2024-09-11T01:04:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.360+0000 7f52656b2740 1 Processor -- start 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.360+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625f64a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68570 0x55a625fb6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0c2e20 con 0x55a625fa45d0 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1f97d0 con 0x55a625f68190 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f525c14bbe0 con 0x55a625f68570 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f52656b2740 10 client.0 _ll_register_callbacks cb 0x7f52480096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41158/0 (socket says 172.21.15.81:41158) 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 -- 172.21.15.81:0/2185407421 learned_addr learned my addr 172.21.15.81:0/2185407421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525b400640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625f64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525aa00640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68570 0x55a625fb6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 -- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68570 msgr2=0x55a625fb6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68570 0x55a625fb6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 -- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 msgr2=0x55a625f64a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625f64a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 -- 172.21.15.81:0/2185407421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a625f6b790 con 0x55a625fa45d0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f525be00640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f525405e2d0 tx=0x7f5254005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a22c75d3a24776 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.361+0000 7f5244c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254020040 con 0x55a625fa45d0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f5254061520 con 0x55a625fa45d0 2024-09-11T01:04:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52480035f0 con 0x55a625fa45d0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f5254098050 con 0x55a625fa45d0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 10 client.5664 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a625fa42e0 con 0x55a625fa45d0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52480035f0 con 0x55a625fa45d0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f525405dc10 con 0x55a625fa45d0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 10 client.5664 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 10 client.5664 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 20 client.5664 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f968a0 0x55a625f96cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 4 client.5664 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b423c791", "release": true, "await": true}] 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.362+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b423c791", "release": true, "await": true}) -- 0x55a625edad70 con 0x55a625f968a0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.363+0000 7f525b400640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f968a0 0x55a625f96cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.363+0000 7f525b400640 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f968a0 0x55a625f96cb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa7c3ed7fc293de server_cookie=5eaa2c84f1fa5525 in_seq=0 out_seq=0 2024-09-11T01:04:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.363+0000 7f5244c00640 10 client.5664 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f5244c00640 1 -- 172.21.15.81:0/2185407421 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a625edad70 con 0x55a625f968a0 2024-09-11T01:04:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f5244c00640 10 client.5664 handle_command_reply: tid=0 2024-09-11T01:04:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 client.5664 shutdown 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 msgr2=0x55a626026070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f525405e2d0 tx=0x7f5254005a90 comp rx=0 tx=0).stop 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 shutdown_connections 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55a625f968a0 0x55a625f96cb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a625fa45d0 0x55a626026070 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a625f68570 0x55a625fb6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 --2- 172.21.15.81:0/2185407421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a625f68190 0x55a625f64a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 >> 172.21.15.81:0/2185407421 conn(0x55a625f65970 msgr2=0x55a625f9bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.399+0000 7f5244c00640 0 client.5664 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 shutdown_connections 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f52656b2740 1 -- 172.21.15.81:0/2185407421 wait complete. 2024-09-11T01:04:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f52656b2740 20 client.5664 trim_cache size 0 max 16384 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 64, 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "b423c791": { 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 64, 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:04:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:24.405 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:04:24.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 msgr2=0x7f523c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 0x7f523c07a460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f524c001770 tx=0x7f524c009040 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 msgr2=0x7f525c1eed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f525400d770 tx=0x7f525400dc30 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 shutdown_connections 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f523c077fa0 0x7f523c07a460 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c0c7a70 0x7f525c1eed90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f525c0725a0 0x7f525c150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 --2- 172.21.15.81:0/1280621480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f525c06f760 0x7f525c0aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.400+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 >> 172.21.15.81:0/1280621480 conn(0x7f525c06ff90 msgr2=0x7f525c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.401+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 shutdown_connections 2024-09-11T01:04:24.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.401+0000 7f5262800640 1 -- 172.21.15.81:0/1280621480 wait complete. 2024-09-11T01:04:24.419 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b423c791', total seconds elapsed: 30.7 2024-09-11T01:04:24.420 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:04:24.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:04:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 -- 172.21.15.81:0/4017965727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f141522a0 msgr2=0x7f8f14152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 --2- 172.21.15.81:0/4017965727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f141522a0 0x7f8f14152680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009890 tx=0x7f8f0402a5d0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 -- 172.21.15.81:0/4017965727 shutdown_connections 2024-09-11T01:04:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 --2- 172.21.15.81:0/4017965727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f141522a0 0x7f8f14152680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 -- 172.21.15.81:0/4017965727 >> 172.21.15.81:0/4017965727 conn(0x7f8f1406f1f0 msgr2=0x7f8f1406f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.597+0000 7f8f13200640 1 -- 172.21.15.81:0/4017965727 shutdown_connections 2024-09-11T01:04:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.598+0000 7f8f13200640 1 -- 172.21.15.81:0/4017965727 wait complete. 2024-09-11T01:04:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.599+0000 7f8f13200640 1 Processor -- start 2024-09-11T01:04:24.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.600+0000 7f8f13200640 1 -- start start 2024-09-11T01:04:24.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f14070d30 0x7f8f14073e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 0x7f8f1415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14158680 con 0x7f8f140c7910 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140c9630 con 0x7f8f141522a0 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f13200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8f14158330 con 0x7f8f14070d30 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f11400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f11400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41162/0 (socket says 172.21.15.81:41162) 2024-09-11T01:04:24.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f11400640 1 -- 172.21.15.81:0/1398381331 learned_addr learned my addr 172.21.15.81:0/1398381331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:24.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f11e00640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f14070d30 0x7f8f14073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.601+0000 7f8f12800640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 0x7f8f1415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 -- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f14070d30 msgr2=0x7f8f14073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f14070d30 0x7f8f14073e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 -- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 msgr2=0x7f8f1415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 0x7f8f1415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 -- 172.21.15.81:0/1398381331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f140af770 con 0x7f8f140c7910 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f12800640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 0x7f8f1415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f11400640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c400 tx=0x7f8f0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00011790 con 0x7f8f140c7910 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f00017070 con 0x7f8f140c7910 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f141f1240 con 0x7f8f140c7910 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00011d00 con 0x7f8f140c7910 2024-09-11T01:04:24.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.602+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1415af60 con 0x7f8f140c7910 2024-09-11T01:04:24.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.604+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f140c88b0 con 0x7f8f140c7910 2024-09-11T01:04:24.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.605+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8f0001c460 con 0x7f8f140c7910 2024-09-11T01:04:24.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.606+0000 7f8f0a000640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 0x7f8ef407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:24.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.606+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8f00099e70 con 0x7f8f140c7910 2024-09-11T01:04:24.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.607+0000 7f8f11e00640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 0x7f8ef407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:24.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.607+0000 7f8f11e00640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 0x7f8ef407a460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f04034000 tx=0x7f8f04004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:24.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.610+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8f140c88b0 con 0x7f8f140c7910 2024-09-11T01:04:24.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.870+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f141528f0 con 0x7f8f140c7910 2024-09-11T01:04:24.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.871+0000 7f8f0a000640 1 -- 172.21.15.81:0/1398381331 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f8f141528f0 con 0x7f8f140c7910 2024-09-11T01:04:24.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:04:24.872 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:04:24.872 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 msgr2=0x7f8ef407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 0x7f8ef407a460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f04034000 tx=0x7f8f04004730 comp rx=0 tx=0).stop 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 msgr2=0x7f8f14159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000c400 tx=0x7f8f0000c8c0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 shutdown_connections 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8ef4077fa0 0x7f8ef407a460 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f141522a0 0x7f8f1415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f140c7910 0x7f8f14159bb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 --2- 172.21.15.81:0/1398381331 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f14070d30 0x7f8f14073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 >> 172.21.15.81:0/1398381331 conn(0x7f8f1406f1f0 msgr2=0x7f8f1406f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 shutdown_connections 2024-09-11T01:04:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:24.873+0000 7f8f13200640 1 -- 172.21.15.81:0/1398381331 wait complete. 2024-09-11T01:04:24.893 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:04:24.894 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 -- 172.21.15.81:0/1899236168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4070570 msgr2=0x7f71b40c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 --2- 172.21.15.81:0/1899236168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4070570 0x7f71b40c6d10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009830 tx=0x7f71a002a5a0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 -- 172.21.15.81:0/1899236168 shutdown_connections 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 --2- 172.21.15.81:0/1899236168 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b40c7250 0x7f71b4162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 --2- 172.21.15.81:0/1899236168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4070570 0x7f71b40c6d10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 -- 172.21.15.81:0/1899236168 >> 172.21.15.81:0/1899236168 conn(0x7f71b40cbe00 msgr2=0x7f71b40cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 -- 172.21.15.81:0/1899236168 shutdown_connections 2024-09-11T01:04:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.099+0000 7f71b3e00640 1 -- 172.21.15.81:0/1899236168 wait complete. 2024-09-11T01:04:25.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.101+0000 7f71b3e00640 1 Processor -- start 2024-09-11T01:04:25.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.101+0000 7f71b3e00640 1 -- start start 2024-09-11T01:04:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 0x7f71b41e1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 0x7f71b41e29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71b406e2f0 con 0x7f71b40c7250 2024-09-11T01:04:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71b406e010 con 0x7f71b414edb0 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f71b414f190 con 0x7f71b4070570 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41186/0 (socket says 172.21.15.81:41186) 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b2000640 1 -- 172.21.15.81:0/2961990457 learned_addr learned my addr 172.21.15.81:0/2961990457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.102+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 0x7f71b41e1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b3400640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 0x7f71b41e29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 -- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 msgr2=0x7f71b41e1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 0x7f71b41e1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 -- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 msgr2=0x7f71b41e29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 0x7f71b41e29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 -- 172.21.15.81:0/2961990457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40c5560 con 0x7f71b40c7250 2024-09-11T01:04:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b3400640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 0x7f71b41e29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 0x7f71b41e1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b2000640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f71a002ab90 tx=0x7f71a0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71aaa00640 1 -- 172.21.15.81:0/2961990457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0041030 con 0x7f71b40c7250 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71aaa00640 1 -- 172.21.15.81:0/2961990457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a0005110 con 0x7f71b40c7250 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71aaa00640 1 -- 172.21.15.81:0/2961990457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0005560 con 0x7f71b40c7250 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.103+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b40c4500 con 0x7f71b40c7250 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.104+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b40c4a80 con 0x7f71b40c7250 2024-09-11T01:04:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.106+0000 7f71aaa00640 1 -- 172.21.15.81:0/2961990457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71a00049b0 con 0x7f71b40c7250 2024-09-11T01:04:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.107+0000 7f71aaa00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 0x7f719407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.107+0000 7f71bcc16740 1 Processor -- start 2024-09-11T01:04:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.107+0000 7f71aaa00640 1 -- 172.21.15.81:0/2961990457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f71a00bb610 con 0x7f71b40c7250 2024-09-11T01:04:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.107+0000 7f71bcc16740 1 -- start start 2024-09-11T01:04:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 0x7f719407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf44d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5640dce82260 con 0x5640dcf4dba0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5640dce71690 con 0x5640dcf100c0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5640dce754a0 con 0x5640dcf097c0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.108+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 0x7f719407a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71a40016a0 tx=0x7f71a4009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf44d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:47472/0 (socket says 172.21.15.81:47472) 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:60436/0 (socket says 172.21.15.81:60436) 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2000640 1 -- 172.21.15.81:0/4145213726 learned_addr learned my addr 172.21.15.81:0/4145213726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 -- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 msgr2=0x5640dcf10800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 -- 172.21.15.81:0/4145213726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 msgr2=0x5640dcf44d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf44d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2a00640 1 -- 172.21.15.81:0/4145213726 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640dcc4bd80 con 0x5640dcf097c0 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b2000640 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.109+0000 7f71b3400640 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf44d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.110+0000 7f71b2a00640 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71a4001de0 tx=0x7f71a4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d34dd723ee8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.110+0000 7f719f400640 1 -- 172.21.15.81:0/4145213726 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4025070 con 0x5640dcf097c0 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.110+0000 7f719f400640 1 -- 172.21.15.81:0/4145213726 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a40158f0 con 0x5640dcf097c0 2024-09-11T01:04:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.110+0000 7f719f400640 1 -- 172.21.15.81:0/4145213726 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4015ce0 con 0x5640dcf097c0 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 -- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 msgr2=0x5640dcf09ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71a4001de0 tx=0x7f71a4011000 comp rx=0 tx=0).stop 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 -- 172.21.15.81:0/4145213726 shutdown_connections 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf44d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf10800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 --2- 172.21.15.81:0/4145213726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf097c0 0x5640dcf09ba0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 -- 172.21.15.81:0/4145213726 >> 172.21.15.81:0/4145213726 conn(0x5640dcf0b520 msgr2=0x5640dcf0edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 -- 172.21.15.81:0/4145213726 shutdown_connections 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.111+0000 7f71bcc16740 1 -- 172.21.15.81:0/4145213726 wait complete. 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.112+0000 7f71bcc16740 1 -- start start 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.112+0000 7f71bcc16740 1 Processor -- start 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf36b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5640dcbe1cc0 con 0x5640dcf37b80 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5640dce16e60 con 0x5640dcf100c0 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5640dcf0f500 con 0x5640dcf4dba0 2024-09-11T01:04:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71bcc16740 10 client.0 _ll_register_callbacks cb 0x5640dce1d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41190/0 (socket says 172.21.15.81:41190) 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:47480/0 (socket says 172.21.15.81:47480) 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b3400640 1 -- 172.21.15.81:0/2775657014 learned_addr learned my addr 172.21.15.81:0/2775657014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.113+0000 7f71b2000640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf36b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 -- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 msgr2=0x5640dcf36b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf36b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 -- 172.21.15.81:0/2775657014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 msgr2=0x5640dcf37090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 -- 172.21.15.81:0/2775657014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640dccac510 con 0x5640dcf100c0 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b3400640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2000640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf36b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71b2a00640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f71a400e530 tx=0x7f71a4016dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77615f0f55f740a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f7193e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:04:25.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4025040 con 0x5640dcf100c0 2024-09-11T01:04:25.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f71a4015ca0 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.114+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71a40158f0 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f71a4033050 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 10 client.5554 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5640dcbb0c20 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a40158f0 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f71a4036020 con 0x5640dcf100c0 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 10 client.5554 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 10 client.5554 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 20 client.5554 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf4cd30 0x5640dcf41d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 4 client.5554 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:04:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.115+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640dce841b0 con 0x5640dcf4cd30 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.116+0000 7f71b2000640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf4cd30 0x5640dcf41d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.117+0000 7f7193e00640 10 client.5554 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.117+0000 7f71b2000640 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf4cd30 0x5640dcf41d30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d70a313a604ccd2 server_cookie=9032eaf13cf39c1e in_seq=0 out_seq=0 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f7193e00640 1 -- 172.21.15.81:0/2775657014 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640dce841b0 con 0x5640dcf4cd30 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f7193e00640 10 client.5554 handle_command_reply: tid=0 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 client.5554 shutdown 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 msgr2=0x5640dcf3f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f71a400e530 tx=0x7f71a4016dc0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 shutdown_connections 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf4cd30 0x5640dcf41d30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf37b80 0x5640dcf37090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf36b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 --2- 172.21.15.81:0/2775657014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf3f0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f7193e00640 0 client.5554 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 >> 172.21.15.81:0/2775657014 conn(0x5640dcf097c0 msgr2=0x5640dcf3d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 shutdown_connections 2024-09-11T01:04:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 1 -- 172.21.15.81:0/2775657014 wait complete. 2024-09-11T01:04:25.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.118+0000 7f71bcc16740 20 client.5554 trim_cache size 0 max 16384 2024-09-11T01:04:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.141+0000 7f71bcc16740 1 Processor -- start 2024-09-11T01:04:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.141+0000 7f71bcc16740 1 -- start start 2024-09-11T01:04:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf37b80 0x5640dcf36c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41fd110 con 0x5640dcf4dba0 2024-09-11T01:04:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41fbff0 con 0x5640dcf100c0 2024-09-11T01:04:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f71b41fa6a0 con 0x5640dcf37b80 2024-09-11T01:04:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.142+0000 7f71b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41202/0 (socket says 172.21.15.81:41202) 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 -- 172.21.15.81:0/594184463 learned_addr learned my addr 172.21.15.81:0/594184463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b2000640 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf37b80 0x5640dcf36c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b2a00640 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 -- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf37b80 msgr2=0x5640dcf36c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf37b80 0x5640dcf36c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 -- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 msgr2=0x5640dcf366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 -- 172.21.15.81:0/594184463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640dcf08b20 con 0x5640dcf4dba0 2024-09-11T01:04:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.143+0000 7f71b3400640 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f71ac011850 tx=0x7f71ac011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844752debc08230b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f719ea00640 1 -- 172.21.15.81:0/594184463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac004d20 con 0x5640dcf4dba0 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f719ea00640 1 -- 172.21.15.81:0/594184463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ac010890 con 0x5640dcf4dba0 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f719ea00640 1 -- 172.21.15.81:0/594184463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac010cc0 con 0x5640dcf4dba0 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 -- 172.21.15.81:0/594184463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 msgr2=0x5640dcf0d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f71ac011850 tx=0x7f71ac011c50 comp rx=0 tx=0).stop 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 -- 172.21.15.81:0/594184463 shutdown_connections 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf4dba0 0x5640dcf0d570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf37b80 0x5640dcf36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 --2- 172.21.15.81:0/594184463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf100c0 0x5640dcf366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 -- 172.21.15.81:0/594184463 >> 172.21.15.81:0/594184463 conn(0x5640dcf097c0 msgr2=0x5640dcf0ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 -- 172.21.15.81:0/594184463 shutdown_connections 2024-09-11T01:04:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.144+0000 7f71bcc16740 1 -- 172.21.15.81:0/594184463 wait complete. 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.145+0000 7f71bcc16740 1 -- start start 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.145+0000 7f71bcc16740 1 Processor -- start 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf37b80 0x5640dcf73f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf74440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41fac20 con 0x5640dcf100c0 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41fb920 con 0x5640dcf37b80 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f71b41fb270 con 0x5640dcf4dba0 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71bcc16740 10 client.0 _ll_register_callbacks cb 0x7f71a002aaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71b2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41216/0 (socket says 172.21.15.81:41216) 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.146+0000 7f71b2a00640 1 -- 172.21.15.81:0/3882542851 learned_addr learned my addr 172.21.15.81:0/3882542851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2000640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf37b80 0x5640dcf73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b3400640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf74440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 -- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 msgr2=0x5640dcf74440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf74440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 -- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf37b80 msgr2=0x5640dcf73f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf37b80 0x5640dcf73f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 -- 172.21.15.81:0/3882542851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640dcf37940 con 0x5640dcf100c0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71b2a00640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f71a40056a0 tx=0x7f71a4015ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26936c8c1729af56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f7193e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4025040 con 0x5640dcf100c0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f71a4029630 con 0x5640dcf100c0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.147+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ac010890 con 0x5640dcf100c0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f71a4043050 con 0x5640dcf100c0 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 10 client.5691 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:25.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5640dcf5a430 con 0x5640dcf100c0 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ac010890 con 0x5640dcf100c0 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f71a4046020 con 0x5640dcf100c0 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 10 client.5691 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 10 client.5691 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 20 client.5691 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf0c8d0 0x5640dcfce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 4 client.5691 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5640dce7fc60 con 0x5640dcf0c8d0 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.148+0000 7f71b2000640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf0c8d0 0x5640dcfce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:25.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.149+0000 7f71b2000640 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf0c8d0 0x5640dcfce200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ad4b2e299295db server_cookie=2c20afd17b6e89d in_seq=0 out_seq=0 2024-09-11T01:04:25.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.149+0000 7f7193e00640 10 client.5691 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.259+0000 7f7193e00640 1 -- 172.21.15.81:0/3882542851 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5640dce7fc60 con 0x5640dcf0c8d0 2024-09-11T01:04:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.259+0000 7f7193e00640 10 client.5691 handle_command_reply: tid=0 2024-09-11T01:04:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.259+0000 7f71bcc16740 1 client.5691 shutdown 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 msgr2=0x5640dcf36c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f71a40056a0 tx=0x7f71a4015ba0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 shutdown_connections 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5640dcf0c8d0 0x5640dcfce200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640dcf4dba0 0x5640dcf74440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640dcf37b80 0x5640dcf73f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f7193e00640 0 client.5691 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 --2- 172.21.15.81:0/3882542851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640dcf100c0 0x5640dcf36c00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 >> 172.21.15.81:0/3882542851 conn(0x5640dcf097c0 msgr2=0x5640dcf0ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 shutdown_connections 2024-09-11T01:04:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 1 -- 172.21.15.81:0/3882542851 wait complete. 2024-09-11T01:04:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.260+0000 7f71bcc16740 20 client.5691 trim_cache size 0 max 16384 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 66, 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:04:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "56eb8a16": { 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 66, 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:25.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 msgr2=0x7f719407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 0x7f719407a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71a40016a0 tx=0x7f71a4009040 comp rx=0 tx=0).stop 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 msgr2=0x7f71b41584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f71a002ab90 tx=0x7f71a0032c10 comp rx=0 tx=0).stop 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 shutdown_connections 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7194077f70 0x7f719407a430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b414edb0 0x7f71b41e29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b40c7250 0x7f71b41584f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 --2- 172.21.15.81:0/2961990457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71b4070570 0x7f71b41e1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 >> 172.21.15.81:0/2961990457 conn(0x7f71b40cbe00 msgr2=0x7f71b414d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 shutdown_connections 2024-09-11T01:04:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:25.261+0000 7f71b3e00640 1 -- 172.21.15.81:0/2961990457 wait complete. 2024-09-11T01:04:25.278 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '56eb8a16', quiesce took 0.9 seconds. Will release after: 29.1 2024-09-11T01:04:52.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:04:52.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:04:54.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:04:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.554+0000 7f08cc200640 1 -- 172.21.15.81:0/2122504371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac003a00 msgr2=0x7f08ac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.554+0000 7f08cc200640 1 --2- 172.21.15.81:0/2122504371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac003a00 0x7f08ac003e20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f08b800bb20 tx=0x7f08ac005830 comp rx=0 tx=0).stop 2024-09-11T01:04:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.554+0000 7f08ca200640 1 -- 172.21.15.81:0/2122504371 reap_dead start 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.555+0000 7f08cc200640 1 -- 172.21.15.81:0/2122504371 shutdown_connections 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.555+0000 7f08cc200640 1 -- 172.21.15.81:0/2122504371 >> 172.21.15.81:0/2122504371 conn(0x7f08c40700f0 msgr2=0x7f08c4070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.555+0000 7f08cc200640 1 -- 172.21.15.81:0/2122504371 shutdown_connections 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.555+0000 7f08cc200640 1 -- 172.21.15.81:0/2122504371 wait complete. 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.556+0000 7f08cc200640 1 Processor -- start 2024-09-11T01:04:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.556+0000 7f08cc200640 1 -- start start 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac003a00 0x7f08c41eead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08c41e3d20 0x7f08c40c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08c40c83a0 con 0x7f08c414b810 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4158380 con 0x7f08ac003a00 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.557+0000 7f08cc200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f08c406ebd0 con 0x7f08c41e3d20 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60136/0 (socket says 172.21.15.81:60136) 2024-09-11T01:04:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 -- 172.21.15.81:0/4158216571 learned_addr learned my addr 172.21.15.81:0/4158216571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c9800640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac003a00 0x7f08c41eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08ca200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08c41e3d20 0x7f08c40c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 -- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08c41e3d20 msgr2=0x7f08c40c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08c41e3d20 0x7f08c40c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 -- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac003a00 msgr2=0x7f08c41eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac003a00 0x7f08c41eead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 -- 172.21.15.81:0/4158216571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c40c5140 con 0x7f08c414b810 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.558+0000 7f08c8e00640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f08b0006680 tx=0x7f08b00066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.559+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0011700 con 0x7f08c414b810 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.559+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08b0016020 con 0x7f08c414b810 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.559+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0011b60 con 0x7f08c414b810 2024-09-11T01:04:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.559+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c40c3660 con 0x7f08c414b810 2024-09-11T01:04:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.559+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c40c3c20 con 0x7f08c414b810 2024-09-11T01:04:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.560+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c406f5e0 con 0x7f08c414b810 2024-09-11T01:04:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.561+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f08b0010420 con 0x7f08c414b810 2024-09-11T01:04:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.562+0000 7f08c1600640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 0x7f08a407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.562+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f08b009a840 con 0x7f08c414b810 2024-09-11T01:04:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.563+0000 7f08c9800640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 0x7f08a407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.563+0000 7f08c9800640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 0x7f08a407a460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08b8036000 tx=0x7f08b80046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.567+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f08b0020030 con 0x7f08c414b810 2024-09-11T01:04:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.783+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08c406f1b0 con 0x7f08c414b810 2024-09-11T01:04:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.783+0000 7f08c1600640 1 -- 172.21.15.81:0/4158216571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f08b0062850 con 0x7f08c414b810 2024-09-11T01:04:54.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:04:54.786 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:04:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 msgr2=0x7f08a407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 0x7f08a407a460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08b8036000 tx=0x7f08b80046c0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 msgr2=0x7f08c40c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f08b0006680 tx=0x7f08b00066b0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 shutdown_connections 2024-09-11T01:04:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f08a4077fa0 0x7f08a407a460 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08c41e3d20 0x7f08c40c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08c414b810 0x7f08c40c4c00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 --2- 172.21.15.81:0/4158216571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac003a00 0x7f08c41eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 >> 172.21.15.81:0/4158216571 conn(0x7f08c40700f0 msgr2=0x7f08c4073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 shutdown_connections 2024-09-11T01:04:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.786+0000 7f08cc200640 1 -- 172.21.15.81:0/4158216571 wait complete. 2024-09-11T01:04:54.804 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 56eb8a16 --release --await' 2024-09-11T01:04:54.804 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 56eb8a16 --release --await 2024-09-11T01:04:54.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 -- 172.21.15.81:0/1327333080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e500c94b0 msgr2=0x7f3e500725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 --2- 172.21.15.81:0/1327333080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e500c94b0 0x7f3e500725e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3e50071e90 tx=0x7f3e4802a940 comp rx=0 tx=0).stop 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 -- 172.21.15.81:0/1327333080 shutdown_connections 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 --2- 172.21.15.81:0/1327333080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e500c94b0 0x7f3e500725e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 --2- 172.21.15.81:0/1327333080 >> v2:172.21.15.167:3300/0 conn(0x7f3e50152930 0x7f3e50074dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 -- 172.21.15.81:0/1327333080 >> 172.21.15.81:0/1327333080 conn(0x7f3e500c8990 msgr2=0x7f3e500c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 -- 172.21.15.81:0/1327333080 shutdown_connections 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.968+0000 7f3e56a00640 1 -- 172.21.15.81:0/1327333080 wait complete. 2024-09-11T01:04:54.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.969+0000 7f3e56a00640 1 Processor -- start 2024-09-11T01:04:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 -- start start 2024-09-11T01:04:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e500c94b0 0x7f3e500ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 0x7f3e5014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500c73c0 con 0x7f3e501e2670 2024-09-11T01:04:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e50158df0 con 0x7f3e50152550 2024-09-11T01:04:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.970+0000 7f3e56a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e500c8280 con 0x7f3e500c94b0 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60152/0 (socket says 172.21.15.81:60152) 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 -- 172.21.15.81:0/2136856408 learned_addr learned my addr 172.21.15.81:0/2136856408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e54c00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 0x7f3e5014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e55600640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e500c94b0 0x7f3e500ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 -- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e500c94b0 msgr2=0x7f3e500ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e500c94b0 0x7f3e500ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 -- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 msgr2=0x7f3e5014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 0x7f3e5014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 -- 172.21.15.81:0/2136856408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e501569a0 con 0x7f3e501e2670 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e54c00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 0x7f3e5014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.971+0000 7f3e56000640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802af30 tx=0x7f3e48031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.972+0000 7f3e4d600640 1 -- 172.21.15.81:0/2136856408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48030430 con 0x7f3e501e2670 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.972+0000 7f3e4d600640 1 -- 172.21.15.81:0/2136856408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e48004240 con 0x7f3e501e2670 2024-09-11T01:04:54.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.972+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501ee990 con 0x7f3e501e2670 2024-09-11T01:04:54.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.972+0000 7f3e4d600640 1 -- 172.21.15.81:0/2136856408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48003e60 con 0x7f3e501e2670 2024-09-11T01:04:54.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.972+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501eec70 con 0x7f3e501e2670 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.974+0000 7f3e4d600640 1 -- 172.21.15.81:0/2136856408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3e4802f070 con 0x7f3e501e2670 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.975+0000 7f3e4d600640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 0x7f3e3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.975+0000 7f3e4d600640 1 -- 172.21.15.81:0/2136856408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3e480bb690 con 0x7f3e501e2670 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.975+0000 7f3e5aea7740 1 Processor -- start 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.975+0000 7f3e55600640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 0x7f3e3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.975+0000 7f3e5aea7740 1 -- start start 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e55600640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 0x7f3e3007a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e440016b0 tx=0x7f3e44009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd1d90 0x55e603c14210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603c09720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e603b46370 con 0x55e603bd2170 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e603b357a0 con 0x55e603bd1d90 2024-09-11T01:04:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.976+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e603b395b0 con 0x55e603c14750 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60162/0 (socket says 172.21.15.81:60162) 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 -- 172.21.15.81:0/4276931544 learned_addr learned my addr 172.21.15.81:0/4276931544 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e55600640 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd1d90 0x55e603c14210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e54c00640 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603c09720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 -- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 msgr2=0x55e603c09720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603c09720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 -- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd1d90 msgr2=0x55e603c14210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd1d90 0x55e603c14210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 -- 172.21.15.81:0/4276931544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e603ace010 con 0x55e603bd2170 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e56000640 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083380 tx=0x7f3e48083510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eec93309fb510f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e41c00640 1 -- 172.21.15.81:0/4276931544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4809a070 con 0x55e603bd2170 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e41c00640 1 -- 172.21.15.81:0/4276931544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e48083d80 con 0x55e603bd2170 2024-09-11T01:04:54.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.977+0000 7f3e41c00640 1 -- 172.21.15.81:0/4276931544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48083680 con 0x55e603bd2170 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 -- 172.21.15.81:0/4276931544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 msgr2=0x55e603c09c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083380 tx=0x7f3e48083510 comp rx=0 tx=0).stop 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 -- 172.21.15.81:0/4276931544 shutdown_connections 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603c09c60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603c09720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/4276931544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd1d90 0x55e603c14210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 -- 172.21.15.81:0/4276931544 >> 172.21.15.81:0/4276931544 conn(0x55e603bcff70 msgr2=0x55e603bd1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:54.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 -- 172.21.15.81:0/4276931544 shutdown_connections 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.978+0000 7f3e5aea7740 1 -- 172.21.15.81:0/4276931544 wait complete. 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.979+0000 7f3e5aea7740 1 -- start start 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.979+0000 7f3e5aea7740 1 Processor -- start 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603c07940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603bd3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e603adcf70 con 0x55e603c01100 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e603adb090 con 0x55e603bd2170 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55e603b46370 con 0x55e603c14750 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e5aea7740 10 client.0 _ll_register_callbacks cb 0x55e603844110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60174/0 (socket says 172.21.15.81:60174) 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e56000640 1 -- 172.21.15.81:0/2144396400 learned_addr learned my addr 172.21.15.81:0/2144396400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:54.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e54c00640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603bd3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.980+0000 7f3e55600640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603c07940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 -- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 msgr2=0x55e603bd3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603bd3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 -- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 msgr2=0x55e603c07940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603c07940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 -- 172.21.15.81:0/2144396400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e603897ea0 con 0x55e603c01100 2024-09-11T01:04:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e55600640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603c07940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e56000640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083f30 tx=0x7f3e48088160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859a6925a272e9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e36000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e480b6030 con 0x55e603c01100 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3e4807f8f0 con 0x55e603c01100 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e48083d80 con 0x55e603c01100 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3e4809a040 con 0x55e603c01100 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e5aea7740 10 client.5712 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.981+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e603910d30 con 0x55e603c01100 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e48083d80 con 0x55e603c01100 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3e4808a070 con 0x55e603c01100 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 10 client.5712 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 10 client.5712 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 20 client.5712 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603bfda30 0x55e603c28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 4 client.5712 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:04:54.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e603b482c0 con 0x55e603bfda30 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.982+0000 7f3e55600640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603bfda30 0x55e603c28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.983+0000 7f3e55600640 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603bfda30 0x55e603c28420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c30b0bdf0847e404 server_cookie=6329a041770b8565 in_seq=0 out_seq=0 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.983+0000 7f3e36000640 10 client.5712 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e36000640 1 -- 172.21.15.81:0/2144396400 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e603b482c0 con 0x55e603bfda30 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e36000640 10 client.5712 handle_command_reply: tid=0 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 client.5712 shutdown 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 msgr2=0x55e603bfd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083f30 tx=0x7f3e48088160 comp rx=0 tx=0).stop 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 shutdown_connections 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603bfda30 0x55e603c28420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c01100 0x55e603bfd4f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c14750 0x55e603bd3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2144396400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603c07940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 >> 172.21.15.81:0/2144396400 conn(0x55e603bd1d90 msgr2=0x55e603c094f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e36000640 0 client.5712 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 shutdown_connections 2024-09-11T01:04:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.984+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2144396400 wait complete. 2024-09-11T01:04:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:54.985+0000 7f3e5aea7740 20 client.5712 trim_cache size 0 max 16384 2024-09-11T01:04:55.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.002+0000 7f3e5aea7740 1 Processor -- start 2024-09-11T01:04:55.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.002+0000 7f3e5aea7740 1 -- start start 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603bd3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603c14750 0x55e603c13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e603c001c0 con 0x55e603bd2170 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e501fad90 con 0x55e603c14750 2024-09-11T01:04:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e501f9c70 con 0x55e603c01100 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e55600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e55600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60178/0 (socket says 172.21.15.81:60178) 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.003+0000 7f3e55600640 1 -- 172.21.15.81:0/959135130 learned_addr learned my addr 172.21.15.81:0/959135130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 -- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 msgr2=0x55e603bd3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603bd3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 -- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603c14750 msgr2=0x55e603c13b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603c14750 0x55e603c13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 -- 172.21.15.81:0/959135130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e603bd4ed0 con 0x55e603bd2170 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e55600640 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e8f0 tx=0x7f3e44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eace4e96f1ddbfa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e41200640 1 -- 172.21.15.81:0/959135130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440255b0 con 0x55e603bd2170 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e41200640 1 -- 172.21.15.81:0/959135130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e4402f070 con 0x55e603bd2170 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.004+0000 7f3e41200640 1 -- 172.21.15.81:0/959135130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440258c0 con 0x55e603bd2170 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- 172.21.15.81:0/959135130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 msgr2=0x55e603bd3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e8f0 tx=0x7f3e44014000 comp rx=0 tx=0).stop 2024-09-11T01:04:55.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- 172.21.15.81:0/959135130 shutdown_connections 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603c14750 0x55e603c13b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603bd3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/959135130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603bd2170 0x55e603bd3010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- 172.21.15.81:0/959135130 >> 172.21.15.81:0/959135130 conn(0x55e603bd1d90 msgr2=0x55e603bcf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- 172.21.15.81:0/959135130 shutdown_connections 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- 172.21.15.81:0/959135130 wait complete. 2024-09-11T01:04:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.005+0000 7f3e5aea7740 1 -- start start 2024-09-11T01:04:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 Processor -- start 2024-09-11T01:04:55.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603bce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603c158d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e501f95a0 con 0x55e603c14750 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e500c2cb0 con 0x55e603bd2170 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e501f88f0 con 0x55e603c01100 2024-09-11T01:04:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.006+0000 7f3e5aea7740 10 client.0 _ll_register_callbacks cb 0x7f3e4807f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60184/0 (socket says 172.21.15.81:60184) 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 -- 172.21.15.81:0/2955306575 learned_addr learned my addr 172.21.15.81:0/2955306575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e55600640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603bce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e54c00640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603c158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 -- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 msgr2=0x55e603c158d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603c158d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 -- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 msgr2=0x55e603bce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603bce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 -- 172.21.15.81:0/2955306575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e603bce820 con 0x55e603c14750 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e54c00640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603c158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e56000640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083610 tx=0x7f3e48031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6600a09bcf02c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.007+0000 7f3e36000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48083d80 con 0x55e603c14750 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3e480b9320 con 0x55e603c14750 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e4402f070 con 0x55e603c14750 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3e480b6050 con 0x55e603c14750 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 10 client.5718 fetch_fsmap learned FSMap version 9 2024-09-11T01:04:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e603bce820 con 0x55e603c14750 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e4402f070 con 0x55e603c14750 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3e4808a040 con 0x55e603c14750 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 10 client.5718 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 10 client.5718 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 20 client.5718 populate_metadata read hostname 'smithi081' 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603c9c820 0x55e603c9cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 4 client.5718 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "56eb8a16", "release": true, "await": true}] 2024-09-11T01:04:55.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.008+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "56eb8a16", "release": true, "await": true}) -- 0x55e603b43d70 con 0x55e603c9c820 2024-09-11T01:04:55.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.009+0000 7f3e55600640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603c9c820 0x55e603c9cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.009+0000 7f3e55600640 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603c9c820 0x55e603c9cc30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8fcf39f69ccdc24 server_cookie=61800d3fb5ccff1c in_seq=0 out_seq=0 2024-09-11T01:04:55.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.009+0000 7f3e36000640 10 client.5718 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e36000640 1 -- 172.21.15.81:0/2955306575 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e603b43d70 con 0x55e603c9c820 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e36000640 10 client.5718 handle_command_reply: tid=0 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 client.5718 shutdown 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 msgr2=0x55e603c12d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e48083610 tx=0x7f3e48031810 comp rx=0 tx=0).stop 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 shutdown_connections 2024-09-11T01:04:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55e603c9c820 0x55e603c9cc30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e603c14750 0x55e603c12d20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e36000640 0 client.5718 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e603c01100 0x55e603c158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 --2- 172.21.15.81:0/2955306575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e603bd2170 0x55e603bce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 >> 172.21.15.81:0/2955306575 conn(0x55e603bd1d90 msgr2=0x55e603bd3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 shutdown_connections 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 1 -- 172.21.15.81:0/2955306575 wait complete. 2024-09-11T01:04:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.030+0000 7f3e5aea7740 20 client.5718 trim_cache size 0 max 16384 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 68, 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "56eb8a16": { 2024-09-11T01:04:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 68, 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:04:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:04:55.037 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 msgr2=0x7f3e3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 0x7f3e3007a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e440016b0 tx=0x7f3e44009040 comp rx=0 tx=0).stop 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 msgr2=0x7f3e5014fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802af30 tx=0x7f3e48031ea0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 shutdown_connections 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3e30077f70 0x7f3e3007a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e501e2670 0x7f3e5014fd40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e50152550 0x7f3e5014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 --2- 172.21.15.81:0/2136856408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e500c94b0 0x7f3e500ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 >> 172.21.15.81:0/2136856408 conn(0x7f3e500c8990 msgr2=0x7f3e500c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 shutdown_connections 2024-09-11T01:04:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:04:55.031+0000 7f3e56a00640 1 -- 172.21.15.81:0/2136856408 wait complete. 2024-09-11T01:04:55.052 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '56eb8a16', total seconds elapsed: 30.6 2024-09-11T01:05:22.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:05:22.148 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:05:55.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:05:55.015 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:15.318 INFO:tasks.workunit.client.0.smithi081.stdout:fs setup took 1193 secs 2024-09-11T01:06:17.353 INFO:tasks.workunit.client.0.smithi081.stdout:Syncing()...2 sec 2024-09-11T01:06:17.355 INFO:tasks.workunit.client.0.smithi081.stdout:Starting Actual Benchmark At: Wed Sep 11 01:06:17 2024 2024-09-11T01:06:17.355 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:06:25.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:25.122 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:46.482 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:06:46.482 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-11T01:06:46.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.992+0000 7efc1e000640 1 -- 172.21.15.81:0/3239788352 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1802e860 con 0x7efc20074750 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 -- 172.21.15.81:0/3239788352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20074750 msgr2=0x7efc200b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 --2- 172.21.15.81:0/3239788352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20074750 0x7efc200b2ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efc18005fd0 tx=0x7efc1802aaa0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 -- 172.21.15.81:0/3239788352 shutdown_connections 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 --2- 172.21.15.81:0/3239788352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20074750 0x7efc200b2ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 --2- 172.21.15.81:0/3239788352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc20151630 0x7efc200c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.993+0000 7efc26200640 1 -- 172.21.15.81:0/3239788352 >> 172.21.15.81:0/3239788352 conn(0x7efc200c9af0 msgr2=0x7efc200c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:52.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.996+0000 7efc26200640 1 -- 172.21.15.81:0/3239788352 shutdown_connections 2024-09-11T01:06:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:52.997+0000 7efc26200640 1 -- 172.21.15.81:0/3239788352 wait complete. 2024-09-11T01:06:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.002+0000 7efc26200640 1 Processor -- start 2024-09-11T01:06:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.003+0000 7efc26200640 1 -- start start 2024-09-11T01:06:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.007+0000 7efc26200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.007+0000 7efc26200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 0x7efc201543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.007+0000 7efc26200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc201f4b90 0x7efc200cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.007+0000 7efc26200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc200736a0 con 0x7efc20074750 2024-09-11T01:06:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.007+0000 7efc26200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc200c7e70 con 0x7efc20151250 2024-09-11T01:06:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.008+0000 7efc26200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efc20157930 con 0x7efc201f4b90 2024-09-11T01:06:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44092/0 (socket says 172.21.15.81:44092) 2024-09-11T01:06:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 -- 172.21.15.81:0/1099153321 learned_addr learned my addr 172.21.15.81:0/1099153321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 -- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc201f4b90 msgr2=0x7efc200cb870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:06:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc201f4b90 0x7efc200cb870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.010+0000 7efc1f400640 1 -- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 msgr2=0x7efc201543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.011+0000 7efc1ea00640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 0x7efc201543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.011+0000 7efc1f400640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 0x7efc201543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.011+0000 7efc1f400640 1 -- 172.21.15.81:0/1099153321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc20157730 con 0x7efc20074750 2024-09-11T01:06:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.011+0000 7efc1ea00640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 0x7efc201543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:06:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.011+0000 7efc1f400640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc1000b3f0 tx=0x7efc1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.012+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10015020 con 0x7efc20074750 2024-09-11T01:06:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.012+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc10011920 con 0x7efc20074750 2024-09-11T01:06:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.012+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201f8fe0 con 0x7efc20074750 2024-09-11T01:06:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.013+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc20161720 con 0x7efc20074750 2024-09-11T01:06:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.013+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10015020 con 0x7efc20074750 2024-09-11T01:06:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.019+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efc1001a400 con 0x7efc20074750 2024-09-11T01:06:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.023+0000 7efc17400640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 0x7efc0007a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.023+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7efc10099a20 con 0x7efc20074750 2024-09-11T01:06:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.023+0000 7efc1ea00640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 0x7efc0007a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.025+0000 7efc1ea00640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 0x7efc0007a630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc20146340 tx=0x7efc0c005cb0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.027+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf8005290 con 0x7efc20074750 2024-09-11T01:06:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.045+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efc1001f030 con 0x7efc20074750 2024-09-11T01:06:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.530+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbf8005850 con 0x7efc20074750 2024-09-11T01:06:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.531+0000 7efc17400640 1 -- 172.21.15.81:0/1099153321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7efc10062240 con 0x7efc20074750 2024-09-11T01:06:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:06:53.537 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:06:53.538 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:06:53.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.536+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 msgr2=0x7efc0007a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:53.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.536+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 0x7efc0007a630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efc20146340 tx=0x7efc0c005cb0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.537+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 msgr2=0x7efc201f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.537+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc1000b3f0 tx=0x7efc1000b8b0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 shutdown_connections 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efc00078170 0x7efc0007a630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc201f4b90 0x7efc200cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc20151250 0x7efc201543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 --2- 172.21.15.81:0/1099153321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20074750 0x7efc201f8aa0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.538+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 >> 172.21.15.81:0/1099153321 conn(0x7efc200c9af0 msgr2=0x7efc200c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.539+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 shutdown_connections 2024-09-11T01:06:53.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:53.539+0000 7efc26200640 1 -- 172.21.15.81:0/1099153321 wait complete. 2024-09-11T01:06:53.589 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-11T01:06:53.590 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-11T01:06:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.034+0000 7f3f90000640 1 -- 172.21.15.81:0/238223245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f88074930 msgr2=0x7f3f880c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.034+0000 7f3f90000640 1 --2- 172.21.15.81:0/238223245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f88074930 0x7f3f880c6d70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3f88069420 tx=0x7f3f8002a8d0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.035+0000 7f3f90000640 1 -- 172.21.15.81:0/238223245 shutdown_connections 2024-09-11T01:06:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.035+0000 7f3f90000640 1 --2- 172.21.15.81:0/238223245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f88074930 0x7f3f880c6d70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.035+0000 7f3f90000640 1 --2- 172.21.15.81:0/238223245 >> v2:172.21.15.167:3300/0 conn(0x7f3f880c16f0 0x7f3f88153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.035+0000 7f3f90000640 1 --2- 172.21.15.81:0/238223245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.035+0000 7f3f90000640 1 -- 172.21.15.81:0/238223245 >> 172.21.15.81:0/238223245 conn(0x7f3f88070030 msgr2=0x7f3f88070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.036+0000 7f3f90000640 1 -- 172.21.15.81:0/238223245 shutdown_connections 2024-09-11T01:06:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.036+0000 7f3f90000640 1 -- 172.21.15.81:0/238223245 wait complete. 2024-09-11T01:06:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.039+0000 7f3f90000640 1 Processor -- start 2024-09-11T01:06:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.039+0000 7f3f90000640 1 -- start start 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.040+0000 7f3f90000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.040+0000 7f3f90000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.040+0000 7f3f90000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33076/0 (socket says 172.21.15.81:33076) 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42946/0 (socket says 172.21.15.81:42946) 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f90000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880c7430 con 0x7f3f880c16f0 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f90000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880c72b0 con 0x7f3f88074930 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f90000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3f880c75b0 con 0x7f3f88072590 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:59610/0 (socket says 172.21.15.81:59610) 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.041+0000 7f3f8cc00640 1 -- 172.21.15.81:0/2703551799 learned_addr learned my addr 172.21.15.81:0/2703551799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.042+0000 7f3f8cc00640 1 -- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 msgr2=0x7f3f880c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.042+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.042+0000 7f3f8cc00640 1 -- 172.21.15.81:0/2703551799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 msgr2=0x7f3f881f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.043+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.043+0000 7f3f8d600640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-11T01:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.043+0000 7f3f8cc00640 1 -- 172.21.15.81:0/2703551799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88159450 con 0x7f3f88074930 2024-09-11T01:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.044+0000 7f3f8e000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.044+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00d730 tx=0x7f3f7c00dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.045+0000 7f3f85600640 1 -- 172.21.15.81:0/2703551799 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c017070 con 0x7f3f88074930 2024-09-11T01:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.045+0000 7f3f85600640 1 -- 172.21.15.81:0/2703551799 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7c009b20 con 0x7f3f88074930 2024-09-11T01:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.046+0000 7f3f85600640 1 -- 172.21.15.81:0/2703551799 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004020 con 0x7f3f88074930 2024-09-11T01:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.046+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f88159730 con 0x7f3f88074930 2024-09-11T01:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.046+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f881f6ba0 con 0x7f3f88074930 2024-09-11T01:06:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.052+0000 7f3f85600640 1 -- 172.21.15.81:0/2703551799 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3f7c0041c0 con 0x7f3f88074930 2024-09-11T01:06:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.053+0000 7f3f85600640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 0x7f3f6807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.054+0000 7f3f85600640 1 -- 172.21.15.81:0/2703551799 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3f7c09a190 con 0x7f3f88074930 2024-09-11T01:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.055+0000 7f3f8d600640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 0x7f3f6807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.056+0000 7f3f92eba740 1 Processor -- start 2024-09-11T01:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.056+0000 7f3f92eba740 1 -- start start 2024-09-11T01:06:54.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.056+0000 7f3f8d600640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 0x7f3f6807a500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f74005fd0 tx=0x7f3f74009260 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 0x555d659c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555d65933240 con 0x555d659beb40 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555d65922670 con 0x555d659bba00 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555d65926480 con 0x555d659be1a0 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.058+0000 7f3f8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.059+0000 7f3f8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33090/0 (socket says 172.21.15.81:33090) 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.059+0000 7f3f8d600640 1 -- 172.21.15.81:0/3795495012 learned_addr learned my addr 172.21.15.81:0/3795495012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.060+0000 7f3f8d600640 1 -- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 msgr2=0x555d659c00f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.060+0000 7f3f8e000640 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 0x555d659c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.062+0000 7f3f8d600640 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 0x555d659c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.062+0000 7f3f8d600640 1 -- 172.21.15.81:0/3795495012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 msgr2=0x555d659bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.062+0000 7f3f8d600640 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.062+0000 7f3f8d600640 1 -- 172.21.15.81:0/3795495012 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d656fcde0 con 0x555d659be1a0 2024-09-11T01:06:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.062+0000 7f3f8e000640 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 0x555d659c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:06:54.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.071+0000 7f3f8d600640 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400fe20 tx=0x7f3f74012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1b1a49524c05f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.073+0000 7f3f79c00640 1 -- 172.21.15.81:0/3795495012 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74022070 con 0x555d659be1a0 2024-09-11T01:06:54.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.073+0000 7f3f79c00640 1 -- 172.21.15.81:0/3795495012 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7401e650 con 0x555d659be1a0 2024-09-11T01:06:54.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.073+0000 7f3f79c00640 1 -- 172.21.15.81:0/3795495012 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7401ea80 con 0x555d659be1a0 2024-09-11T01:06:54.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.077+0000 7f3f92eba740 1 -- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 msgr2=0x555d659bb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.077+0000 7f3f92eba740 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400fe20 tx=0x7f3f74012000 comp rx=0 tx=0).stop 2024-09-11T01:06:54.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.082+0000 7f3f92eba740 1 -- 172.21.15.81:0/3795495012 shutdown_connections 2024-09-11T01:06:54.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.082+0000 7f3f92eba740 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659bba00 0x555d659c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.082+0000 7f3f92eba740 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.082+0000 7f3f92eba740 1 --2- 172.21.15.81:0/3795495012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bb4c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.082+0000 7f3f92eba740 1 -- 172.21.15.81:0/3795495012 >> 172.21.15.81:0/3795495012 conn(0x555d659bc340 msgr2=0x555d659bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.083+0000 7f3f92eba740 1 -- 172.21.15.81:0/3795495012 shutdown_connections 2024-09-11T01:06:54.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.083+0000 7f3f92eba740 1 -- 172.21.15.81:0/3795495012 wait complete. 2024-09-11T01:06:54.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.085+0000 7f3f92eba740 1 -- start start 2024-09-11T01:06:54.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.087+0000 7f3f92eba740 1 Processor -- start 2024-09-11T01:06:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.090+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 0x555d65a06220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.090+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.091+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659eab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.091+0000 7f3f92eba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555d65692d20 con 0x555d659be1a0 2024-09-11T01:06:54.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.091+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555d658c7dd0 con 0x555d659beb40 2024-09-11T01:06:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.092+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x555d659bae00 con 0x555d659eb6f0 2024-09-11T01:06:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.092+0000 7f3f92eba740 10 client.0 _ll_register_callbacks cb 0x555d656301c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:06:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:59626/0 (socket says 172.21.15.81:59626) 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8cc00640 1 -- 172.21.15.81:0/831202720 learned_addr learned my addr 172.21.15.81:0/831202720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8d600640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 0x555d65a06220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.093+0000 7f3f8cc00640 1 -- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 msgr2=0x555d659eab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.094+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659eab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.094+0000 7f3f8cc00640 1 -- 172.21.15.81:0/831202720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 msgr2=0x555d65a06220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.094+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 0x555d65a06220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.094+0000 7f3f8cc00640 1 -- 172.21.15.81:0/831202720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d6575d570 con 0x555d659beb40 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.094+0000 7f3f8d600640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 0x555d65a06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.095+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009610 tx=0x7f3f7c062120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5ecb0f6b51054d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.095+0000 7f3f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.095+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c020040 con 0x555d659beb40 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.095+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3f7c05db70 con 0x555d659beb40 2024-09-11T01:06:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.096+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7401e650 con 0x555d659beb40 2024-09-11T01:06:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.096+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3f7c062220 con 0x555d659beb40 2024-09-11T01:06:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.097+0000 7f3f92eba740 10 client.5593 fetch_fsmap learned FSMap version 9 2024-09-11T01:06:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.097+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555d65661c80 con 0x555d659beb40 2024-09-11T01:06:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.098+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7401e650 con 0x555d659beb40 2024-09-11T01:06:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.098+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3f7c05dd70 con 0x555d659beb40 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 10 client.5593 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 10 client.5593 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 20 client.5593 populate_metadata read hostname 'smithi081' 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659f21f0 0x555d659f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 4 client.5593 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d65935190 con 0x555d659f21f0 2024-09-11T01:06:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.099+0000 7f3f8d600640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659f21f0 0x555d659f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.101+0000 7f3f6e000640 10 client.5593 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:06:54.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.101+0000 7f3f8d600640 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659f21f0 0x555d659f25d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b0fce2ca914a83 server_cookie=724d879cb6d047e0 in_seq=0 out_seq=0 2024-09-11T01:06:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.103+0000 7f3f6e000640 1 -- 172.21.15.81:0/831202720 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d65935190 con 0x555d659f21f0 2024-09-11T01:06:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.103+0000 7f3f6e000640 10 client.5593 handle_command_reply: tid=0 2024-09-11T01:06:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.103+0000 7f3f92eba740 1 client.5593 shutdown 2024-09-11T01:06:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.104+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 msgr2=0x555d659ea620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.104+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009610 tx=0x7f3f7c062120 comp rx=0 tx=0).stop 2024-09-11T01:06:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.104+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 shutdown_connections 2024-09-11T01:06:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.104+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659f21f0 0x555d659f25d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659eab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f6e000640 0 client.5593 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:06:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659beb40 0x555d659ea620 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 --2- 172.21.15.81:0/831202720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659be1a0 0x555d65a06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 >> 172.21.15.81:0/831202720 conn(0x555d659bba00 msgr2=0x555d659f6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 shutdown_connections 2024-09-11T01:06:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.105+0000 7f3f92eba740 1 -- 172.21.15.81:0/831202720 wait complete. 2024-09-11T01:06:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.106+0000 7f3f92eba740 20 client.5593 trim_cache size 0 max 16384 2024-09-11T01:06:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.189+0000 7f3f92eba740 1 Processor -- start 2024-09-11T01:06:54.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.191+0000 7f3f92eba740 1 -- start start 2024-09-11T01:06:54.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.192+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659be1a0 0x555d659ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.192+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.193+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f92eba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8815e910 con 0x555d659beb40 2024-09-11T01:06:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8815d830 con 0x555d659be1a0 2024-09-11T01:06:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3f881f9620 con 0x555d659eb6f0 2024-09-11T01:06:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33104/0 (socket says 172.21.15.81:33104) 2024-09-11T01:06:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f8e000640 1 -- 172.21.15.81:0/570326788 learned_addr learned my addr 172.21.15.81:0/570326788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.194+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.196+0000 7f3f8d600640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659be1a0 0x555d659ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8cc00640 1 -- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 msgr2=0x555d659bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8cc00640 1 -- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659be1a0 msgr2=0x555d659ea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659be1a0 0x555d659ea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8cc00640 1 -- 172.21.15.81:0/570326788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d659bf290 con 0x555d659beb40 2024-09-11T01:06:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.200+0000 7f3f8e000640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.201+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bd320 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0623e0 tx=0x7f3f7c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b662db0b4ed331c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.202+0000 7f3f79200640 1 -- 172.21.15.81:0/570326788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c020070 con 0x555d659beb40 2024-09-11T01:06:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.202+0000 7f3f79200640 1 -- 172.21.15.81:0/570326788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7c05e490 con 0x555d659beb40 2024-09-11T01:06:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.202+0000 7f3f79200640 1 -- 172.21.15.81:0/570326788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c049dc0 con 0x555d659beb40 2024-09-11T01:06:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 -- 172.21.15.81:0/570326788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 msgr2=0x555d659bd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bd320 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0623e0 tx=0x7f3f7c004570 comp rx=0 tx=0).stop 2024-09-11T01:06:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 -- 172.21.15.81:0/570326788 shutdown_connections 2024-09-11T01:06:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659eb6f0 0x555d659bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659beb40 0x555d659bd320 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 --2- 172.21.15.81:0/570326788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659be1a0 0x555d659ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.203+0000 7f3f92eba740 1 -- 172.21.15.81:0/570326788 >> 172.21.15.81:0/570326788 conn(0x555d659bba00 msgr2=0x555d659b5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.204+0000 7f3f92eba740 1 -- 172.21.15.81:0/570326788 shutdown_connections 2024-09-11T01:06:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.204+0000 7f3f92eba740 1 -- 172.21.15.81:0/570326788 wait complete. 2024-09-11T01:06:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.205+0000 7f3f92eba740 1 -- start start 2024-09-11T01:06:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.206+0000 7f3f92eba740 1 Processor -- start 2024-09-11T01:06:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.208+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.208+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 0x555d659f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.208+0000 7f3f92eba740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.209+0000 7f3f92eba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f881501c0 con 0x555d659eb6f0 2024-09-11T01:06:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.209+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8815d180 con 0x555d659f21f0 2024-09-11T01:06:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.209+0000 7f3f92eba740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8815cb30 con 0x555d659be1a0 2024-09-11T01:06:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.209+0000 7f3f92eba740 10 client.0 _ll_register_callbacks cb 0x7f3f7c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:06:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.210+0000 7f3f8cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 0x555d659f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.210+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.210+0000 7f3f8e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:59652/0 (socket says 172.21.15.81:59652) 2024-09-11T01:06:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.210+0000 7f3f8e000640 1 -- 172.21.15.81:0/1431543082 learned_addr learned my addr 172.21.15.81:0/1431543082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:06:54.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.213+0000 7f3f8e000640 1 -- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 msgr2=0x555d659bf7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:06:54.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.213+0000 7f3f8e000640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bf7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.213+0000 7f3f8e000640 1 -- 172.21.15.81:0/1431543082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 msgr2=0x555d659f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:06:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.213+0000 7f3f8e000640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 0x555d659f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.213+0000 7f3f8e000640 1 -- 172.21.15.81:0/1431543082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d65a0e950 con 0x555d659f21f0 2024-09-11T01:06:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.214+0000 7f3f8cc00640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 0x555d659f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.215+0000 7f3f8e000640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f80003ce0 tx=0x7f3f80003d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4133453419356d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.217+0000 7f3f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:06:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.217+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80004380 con 0x555d659f21f0 2024-09-11T01:06:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.217+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3f80004520 con 0x555d659f21f0 2024-09-11T01:06:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.217+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7c05e490 con 0x555d659f21f0 2024-09-11T01:06:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.218+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3f80004720 con 0x555d659f21f0 2024-09-11T01:06:54.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.220+0000 7f3f92eba740 10 client.5599 fetch_fsmap learned FSMap version 9 2024-09-11T01:06:54.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.220+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555d659f2940 con 0x555d659f21f0 2024-09-11T01:06:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.223+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7c05e490 con 0x555d659f21f0 2024-09-11T01:06:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.229+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3f80062020 con 0x555d659f21f0 2024-09-11T01:06:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.229+0000 7f3f92eba740 10 client.5599 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.230+0000 7f3f92eba740 10 client.5599 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.230+0000 7f3f92eba740 20 client.5599 populate_metadata read hostname 'smithi081' 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.230+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659ff480 0x555d659f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.230+0000 7f3f92eba740 4 client.5599 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.230+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x555d65930c40 con 0x555d659ff480 2024-09-11T01:06:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.231+0000 7f3f8d600640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659ff480 0x555d659f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.231+0000 7f3f8d600640 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659ff480 0x555d659f97c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca00015664dd563 server_cookie=5439cb1aeba4e3cc in_seq=0 out_seq=0 2024-09-11T01:06:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.231+0000 7f3f6e000640 10 client.5599 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:06:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.461+0000 7f3f6e000640 1 -- 172.21.15.81:0/1431543082 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555d65930c40 con 0x555d659ff480 2024-09-11T01:06:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.461+0000 7f3f6e000640 10 client.5599 handle_command_reply: tid=0 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.461+0000 7f3f92eba740 1 client.5599 shutdown 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 msgr2=0x555d659f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f80003ce0 tx=0x7f3f80003d10 comp rx=0 tx=0).stop 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 shutdown_connections 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x555d659ff480 0x555d659f97c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d659f21f0 0x555d659f9280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d659eb6f0 0x555d659f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 --2- 172.21.15.81:0/1431543082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x555d659be1a0 0x555d659bf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 >> 172.21.15.81:0/1431543082 conn(0x555d659bba00 msgr2=0x555d65a057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f6e000640 0 client.5599 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:06:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 shutdown_connections 2024-09-11T01:06:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.462+0000 7f3f92eba740 1 -- 172.21.15.81:0/1431543082 wait complete. 2024-09-11T01:06:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f92eba740 20 client.5599 trim_cache size 0 max 16384 2024-09-11T01:06:54.466 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:06:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:06:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 70, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "c82f1ea4": { 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 70, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 138.8, 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:06:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:06:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 msgr2=0x7f3f6807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 0x7f3f6807a500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f74005fd0 tx=0x7f3f74009260 comp rx=0 tx=0).stop 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 msgr2=0x7f3f881529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00d730 tx=0x7f3f7c00dbf0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 shutdown_connections 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3f68078040 0x7f3f6807a500 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f880c16f0 0x7f3f881f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f88074930 0x7f3f881529d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 --2- 172.21.15.81:0/2703551799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f88072590 0x7f3f880c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:54.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.463+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 >> 172.21.15.81:0/2703551799 conn(0x7f3f88070030 msgr2=0x7f3f88163630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:54.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.464+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 shutdown_connections 2024-09-11T01:06:54.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:06:54.464+0000 7f3f90000640 1 -- 172.21.15.81:0/2703551799 wait complete. 2024-09-11T01:06:54.489 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c82f1ea4', quiesce took 8.0 seconds. Will release after: 10.850000000000001 2024-09-11T01:06:55.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:06:55.359 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:05.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 -- 172.21.15.81:0/3501669162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3300b1f10 msgr2=0x7fa3300745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 --2- 172.21.15.81:0/3501669162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3300b1f10 0x7fa3300745f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa33006d0c0 tx=0x7fa31c02a490 comp rx=0 tx=0).stop 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 -- 172.21.15.81:0/3501669162 shutdown_connections 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 --2- 172.21.15.81:0/3501669162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa330074b30 0x7fa33015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 --2- 172.21.15.81:0/3501669162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3300b1f10 0x7fa3300745f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 --2- 172.21.15.81:0/3501669162 >> v2:172.21.15.81:3300/0 conn(0x7fa33014ebc0 0x7fa33006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 -- 172.21.15.81:0/3501669162 >> 172.21.15.81:0/3501669162 conn(0x7fa33006ffd0 msgr2=0x7fa3300703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 -- 172.21.15.81:0/3501669162 shutdown_connections 2024-09-11T01:07:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.515+0000 7fa335e00640 1 -- 172.21.15.81:0/3501669162 wait complete. 2024-09-11T01:07:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.517+0000 7fa335e00640 1 Processor -- start 2024-09-11T01:07:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.517+0000 7fa335e00640 1 -- start start 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa330074b30 0x7fa3301e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa33014ebc0 0x7fa3301f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300c7040 con 0x7fa3300b1f10 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301581a0 con 0x7fa330074b30 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa33014efa0 con 0x7fa33014ebc0 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55986/0 (socket says 172.21.15.81:55986) 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 -- 172.21.15.81:0/132636024 learned_addr learned my addr 172.21.15.81:0/132636024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa334a00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa330074b30 0x7fa3301e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa335400640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa33014ebc0 0x7fa3301f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 -- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa33014ebc0 msgr2=0x7fa3301f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa33014ebc0 0x7fa3301f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 -- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa330074b30 msgr2=0x7fa3301e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa330074b30 0x7fa3301e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.518+0000 7fa32fe00640 1 -- 172.21.15.81:0/132636024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33015b620 con 0x7fa3300b1f10 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa32fe00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009920 tx=0x7fa31c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c040070 con 0x7fa3300b1f10 2024-09-11T01:07:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301f0a00 con 0x7fa3300b1f10 2024-09-11T01:07:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa31c005310 con 0x7fa3300b1f10 2024-09-11T01:07:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0047a0 con 0x7fa3300b1f10 2024-09-11T01:07:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.519+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa330073d10 con 0x7fa3300b1f10 2024-09-11T01:07:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.520+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3300745f0 con 0x7fa3300b1f10 2024-09-11T01:07:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.521+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa31c004b50 con 0x7fa3300b1f10 2024-09-11T01:07:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.522+0000 7fa32cc00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 0x7fa31007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.522+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa31c0bb570 con 0x7fa3300b1f10 2024-09-11T01:07:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.523+0000 7fa334a00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 0x7fa31007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.524+0000 7fa334a00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 0x7fa31007a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3240096c0 tx=0x7fa324009260 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.527+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa31c083620 con 0x7fa3300b1f10 2024-09-11T01:07:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.743+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3301f0bd0 con 0x7fa3300b1f10 2024-09-11T01:07:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.744+0000 7fa32cc00640 1 -- 172.21.15.81:0/132636024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fa31c088050 con 0x7fa3300b1f10 2024-09-11T01:07:05.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:07:05.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:07:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:07:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 msgr2=0x7fa31007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 0x7fa31007a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3240096c0 tx=0x7fa324009260 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 msgr2=0x7fa3301f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009920 tx=0x7fa31c032c10 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 shutdown_connections 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa310077f70 0x7fa31007a430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa33014ebc0 0x7fa3301f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3300b1f10 0x7fa3301f0f00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 --2- 172.21.15.81:0/132636024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa330074b30 0x7fa3301e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 >> 172.21.15.81:0/132636024 conn(0x7fa33006ffd0 msgr2=0x7fa330156590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 shutdown_connections 2024-09-11T01:07:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.746+0000 7fa335e00640 1 -- 172.21.15.81:0/132636024 wait complete. 2024-09-11T01:07:05.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id c82f1ea4 --release --await' 2024-09-11T01:07:05.764 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id c82f1ea4 --release --await 2024-09-11T01:07:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.927+0000 7fe9d3000640 1 -- 172.21.15.81:0/1888457705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 msgr2=0x7fe9cc070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.927+0000 7fe9d3000640 1 --2- 172.21.15.81:0/1888457705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc070c40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0ccee0 tx=0x7fe9bc02a5f0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 -- 172.21.15.81:0/1888457705 shutdown_connections 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 --2- 172.21.15.81:0/1888457705 >> v2:172.21.15.167:3300/0 conn(0x7fe9cc0725a0 0x7fe9cc0729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 --2- 172.21.15.81:0/1888457705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc070c40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 -- 172.21.15.81:0/1888457705 >> 172.21.15.81:0/1888457705 conn(0x7fe9cc06ff90 msgr2=0x7fe9cc0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 -- 172.21.15.81:0/1888457705 shutdown_connections 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.928+0000 7fe9d3000640 1 -- 172.21.15.81:0/1888457705 wait complete. 2024-09-11T01:07:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.929+0000 7fe9d3000640 1 Processor -- start 2024-09-11T01:07:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.929+0000 7fe9d3000640 1 -- start start 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9cc0725a0 0x7fe9cc0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9cc0c7360 0x7fe9cc0c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc074db0 con 0x7fe9cc06f760 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc0c6bf0 con 0x7fe9cc0725a0 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9d3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc0c6e40 con 0x7fe9cc0c7360 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.930+0000 7fe9cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55998/0 (socket says 172.21.15.81:55998) 2024-09-11T01:07:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 -- 172.21.15.81:0/2323931194 learned_addr learned my addr 172.21.15.81:0/2323931194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9cc0725a0 0x7fe9cc0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9d1000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9cc0c7360 0x7fe9cc0c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 -- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9cc0c7360 msgr2=0x7fe9cc0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9cc0c7360 0x7fe9cc0c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 -- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9cc0725a0 msgr2=0x7fe9cc0c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9cc0725a0 0x7fe9cc0c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 -- 172.21.15.81:0/2323931194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc14ece0 con 0x7fe9cc06f760 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.931+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000c00 tx=0x7fe9bc003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.932+0000 7fe9c8c00640 1 -- 172.21.15.81:0/2323931194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc03f070 con 0x7fe9cc06f760 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.932+0000 7fe9c8c00640 1 -- 172.21.15.81:0/2323931194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9bc004890 con 0x7fe9cc06f760 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.932+0000 7fe9c8c00640 1 -- 172.21.15.81:0/2323931194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc035030 con 0x7fe9cc06f760 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.932+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc155b90 con 0x7fe9cc06f760 2024-09-11T01:07:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.932+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1f1d00 con 0x7fe9cc06f760 2024-09-11T01:07:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.934+0000 7fe9c8c00640 1 -- 172.21.15.81:0/2323931194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe9bc004ca0 con 0x7fe9cc06f760 2024-09-11T01:07:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.935+0000 7fe9c8c00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 0x7fe9a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.935+0000 7fe9c8c00640 1 -- 172.21.15.81:0/2323931194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe9bc0bb200 con 0x7fe9cc06f760 2024-09-11T01:07:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.935+0000 7fe9d5e08740 1 Processor -- start 2024-09-11T01:07:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.935+0000 7fe9d5e08740 1 -- start start 2024-09-11T01:07:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 0x7fe9a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 0x7fe9a807a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1e8540 tx=0x7fe9b4009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc190 0x55659a1cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a203830 0x55659a203cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55659a141370 con 0x55659a1cc570 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55659a1307a0 con 0x55659a1cc190 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.936+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55659a1345b0 con 0x55659a203830 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56006/0 (socket says 172.21.15.81:56006) 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 -- 172.21.15.81:0/2971084639 learned_addr learned my addr 172.21.15.81:0/2971084639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc190 0x55659a1cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9d1000640 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a203830 0x55659a203cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 -- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a203830 msgr2=0x55659a203cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a203830 0x55659a203cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 -- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc190 msgr2=0x55659a1cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc190 0x55659a1cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 -- 172.21.15.81:0/2971084639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659a0c9010 con 0x55659a1cc570 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.937+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400f930 tx=0x7fe9b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14658287d723a9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9c0c00640 1 -- 172.21.15.81:0/2971084639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4025070 con 0x55659a1cc570 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9c0c00640 1 -- 172.21.15.81:0/2971084639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b401b050 con 0x55659a1cc570 2024-09-11T01:07:05.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9c0c00640 1 -- 172.21.15.81:0/2971084639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4014e20 con 0x55659a1cc570 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 -- 172.21.15.81:0/2971084639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 msgr2=0x55659a1cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400f930 tx=0x7fe9b4012000 comp rx=0 tx=0).stop 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 -- 172.21.15.81:0/2971084639 shutdown_connections 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a203830 0x55659a203cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a1cc570 0x55659a1cdfc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/2971084639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc190 0x55659a1cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 -- 172.21.15.81:0/2971084639 >> 172.21.15.81:0/2971084639 conn(0x55659a1ca370 msgr2=0x55659a1cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 -- 172.21.15.81:0/2971084639 shutdown_connections 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.938+0000 7fe9d5e08740 1 -- 172.21.15.81:0/2971084639 wait complete. 2024-09-11T01:07:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.939+0000 7fe9d5e08740 1 -- start start 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.939+0000 7fe9d5e08740 1 Processor -- start 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a202040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a2013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55659a0d7f70 con 0x55659a203830 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55659a0d6090 con 0x55659a1cc570 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55659a202a50 con 0x55659a20fbf0 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9d5e08740 10 client.0 _ll_register_callbacks cb 0x556599e3f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.940+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56016/0 (socket says 172.21.15.81:56016) 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3454550523 learned_addr learned my addr 172.21.15.81:0/3454550523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a202040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9d1000640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a2013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 msgr2=0x55659a2013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a2013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 msgr2=0x55659a202040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a202040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3454550523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556599e92ea0 con 0x55659a203830 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4023040 tx=0x7fe9b4020a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4182d426e34f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9b9600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4025050 con 0x55659a203830 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe9b402c650 con 0x55659a203830 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.941+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b401b050 con 0x55659a203830 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4038050 con 0x55659a203830 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 10 client.5754 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556599f0bd30 con 0x55659a203830 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b401b050 con 0x55659a203830 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe9b403b020 con 0x55659a203830 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 10 client.5754 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 10 client.5754 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 20 client.5754 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1f7d00 0x55659a21e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 4 client.5754 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55659a1432c0 con 0x55659a1f7d00 2024-09-11T01:07:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.942+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1f7d00 0x55659a21e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.943+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1f7d00 0x55659a21e1a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8262e0f049e6b8a server_cookie=ad3dc478af68fed in_seq=0 out_seq=0 2024-09-11T01:07:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.943+0000 7fe9b9600640 10 client.5754 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9b9600640 1 -- 172.21.15.81:0/3454550523 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55659a1432c0 con 0x55659a1f7d00 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9b9600640 10 client.5754 handle_command_reply: tid=0 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 client.5754 shutdown 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 msgr2=0x55659a200a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4023040 tx=0x7fe9b4020a30 comp rx=0 tx=0).stop 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 shutdown_connections 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1f7d00 0x55659a21e1a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a2013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a200a10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9b9600640 0 client.5754 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3454550523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a202040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 >> 172.21.15.81:0/3454550523 conn(0x55659a1cc190 msgr2=0x55659a1c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 shutdown_connections 2024-09-11T01:07:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3454550523 wait complete. 2024-09-11T01:07:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.944+0000 7fe9d5e08740 20 client.5754 trim_cache size 0 max 16384 2024-09-11T01:07:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.962+0000 7fe9d5e08740 1 Processor -- start 2024-09-11T01:07:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.962+0000 7fe9d5e08740 1 -- start start 2024-09-11T01:07:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a2011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a1fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55659a1c9590 con 0x55659a203830 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1ff560 con 0x55659a1cc570 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc1fe440 con 0x55659a20fbf0 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56024/0 (socket says 172.21.15.81:56024) 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.963+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3562196482 learned_addr learned my addr 172.21.15.81:0/3562196482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9d1000640 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a1fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a2011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 msgr2=0x55659a1fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a1fedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 msgr2=0x55659a2011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a2011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 -- 172.21.15.81:0/3562196482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659a200d80 con 0x55659a203830 2024-09-11T01:07:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400f900 tx=0x7fe9b4020aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9286c49d51d0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9bbe00640 1 -- 172.21.15.81:0/3562196482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4025040 con 0x55659a203830 2024-09-11T01:07:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9bbe00640 1 -- 172.21.15.81:0/3562196482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b401b040 con 0x55659a203830 2024-09-11T01:07:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.964+0000 7fe9bbe00640 1 -- 172.21.15.81:0/3562196482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b402c450 con 0x55659a203830 2024-09-11T01:07:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3562196482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 msgr2=0x55659a201710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400f900 tx=0x7fe9b4020aa0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3562196482 shutdown_connections 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a20fbf0 0x55659a1fedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a203830 0x55659a201710 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/3562196482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a1cc570 0x55659a2011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3562196482 >> 172.21.15.81:0/3562196482 conn(0x55659a1cc190 msgr2=0x55659a201e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3562196482 shutdown_connections 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.965+0000 7fe9d5e08740 1 -- 172.21.15.81:0/3562196482 wait complete. 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.966+0000 7fe9d5e08740 1 -- start start 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.966+0000 7fe9d5e08740 1 Processor -- start 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a1cc570 0x55659a20ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a203830 0x55659a289e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1fdd70 con 0x55659a20fbf0 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc155430 con 0x55659a203830 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc1f51c0 con 0x55659a1cc570 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d5e08740 10 client.0 _ll_register_callbacks cb 0x7fe9b4023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56026/0 (socket says 172.21.15.81:56026) 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 -- 172.21.15.81:0/508541123 learned_addr learned my addr 172.21.15.81:0/508541123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9c3e00640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a203830 0x55659a289e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a1cc570 0x55659a20ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 -- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a1cc570 msgr2=0x55659a20ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a1cc570 0x55659a20ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 -- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a203830 msgr2=0x55659a289e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a203830 0x55659a289e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.967+0000 7fe9d1000640 1 -- 172.21.15.81:0/508541123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659a20b290 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d1000640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4012760 tx=0x7fe9c4012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2173f3b80171147 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4022060 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe9c4011cd0 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b401b040 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe9c4028050 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 10 client.5760 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55659a232560 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b401b040 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe9c402b020 con 0x55659a20fbf0 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 10 client.5760 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 10 client.5760 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 20 client.5760 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.968+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1fc590 0x55659a21e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.969+0000 7fe9d5e08740 4 client.5760 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c82f1ea4", "release": true, "await": true}] 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.969+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c82f1ea4", "release": true, "await": true}) -- 0x55659a13ed70 con 0x55659a1fc590 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.969+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1fc590 0x55659a21e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.969+0000 7fe9b9600640 10 client.5760 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.969+0000 7fe9cbe00640 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1fc590 0x55659a21e660 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94dcf4ed193677bf server_cookie=453c87bf7cf78979 in_seq=0 out_seq=0 2024-09-11T01:07:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9b9600640 1 -- 172.21.15.81:0/508541123 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55659a13ed70 con 0x55659a1fc590 2024-09-11T01:07:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9b9600640 10 client.5760 handle_command_reply: tid=0 2024-09-11T01:07:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 client.5760 shutdown 2024-09-11T01:07:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 msgr2=0x55659a21e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4012760 tx=0x7fe9c4012c20 comp rx=0 tx=0).stop 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 shutdown_connections 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55659a1fc590 0x55659a21e660 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55659a20fbf0 0x55659a21e120 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55659a203830 0x55659a289e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 --2- 172.21.15.81:0/508541123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55659a1cc570 0x55659a20ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.991+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 >> 172.21.15.81:0/508541123 conn(0x55659a1cc190 msgr2=0x55659a2011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.992+0000 7fe9b9600640 0 client.5760 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.992+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 shutdown_connections 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.992+0000 7fe9d5e08740 1 -- 172.21.15.81:0/508541123 wait complete. 2024-09-11T01:07:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.992+0000 7fe9d5e08740 20 client.5760 trim_cache size 0 max 16384 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 72, 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "c82f1ea4": { 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 72, 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:07:05.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 138.8, 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:05.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:05.997 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:07:05.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 msgr2=0x7fe9a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 0x7fe9a807a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1e8540 tx=0x7fe9b4009040 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 msgr2=0x7fe9cc0c2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000c00 tx=0x7fe9bc003960 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 shutdown_connections 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe9a8077f70 0x7fe9a807a430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9cc0c7360 0x7fe9cc0c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9cc0725a0 0x7fe9cc0c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 --2- 172.21.15.81:0/2323931194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9cc06f760 0x7fe9cc0c2e20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 >> 172.21.15.81:0/2323931194 conn(0x7fe9cc06ff90 msgr2=0x7fe9cc157100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.993+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 shutdown_connections 2024-09-11T01:07:05.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:05.994+0000 7fe9d3000640 1 -- 172.21.15.81:0/2323931194 wait complete. 2024-09-11T01:07:06.017 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c82f1ea4', total seconds elapsed: 19.5 2024-09-11T01:07:06.017 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-11T01:07:06.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:07:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 -- 172.21.15.81:0/63877151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 msgr2=0x7fa1c404bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 --2- 172.21.15.81:0/63877151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c404bd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4007530 tx=0x7fa1c002b200 comp rx=0 tx=0).stop 2024-09-11T01:07:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 -- 172.21.15.81:0/63877151 shutdown_connections 2024-09-11T01:07:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 --2- 172.21.15.81:0/63877151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4045d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 --2- 172.21.15.81:0/63877151 >> v2:172.21.15.81:3300/0 conn(0x7fa1c40da540 0x7fa1c4044a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 --2- 172.21.15.81:0/63877151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c404bd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.438+0000 7fa1d0a00640 1 -- 172.21.15.81:0/63877151 >> 172.21.15.81:0/63877151 conn(0x7fa1c404fc00 msgr2=0x7fa1c4050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.439+0000 7fa1d0a00640 1 -- 172.21.15.81:0/63877151 shutdown_connections 2024-09-11T01:07:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.439+0000 7fa1d0a00640 1 -- 172.21.15.81:0/63877151 wait complete. 2024-09-11T01:07:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.441+0000 7fa1d0a00640 1 Processor -- start 2024-09-11T01:07:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.442+0000 7fa1d0a00640 1 -- start start 2024-09-11T01:07:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.444+0000 7fa1d0a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.445+0000 7fa1d0a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c416ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.445+0000 7fa1d0a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 0x7fa1c404f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.446+0000 7fa1cb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.446+0000 7fa1cb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:34332/0 (socket says 172.21.15.81:34332) 2024-09-11T01:07:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.446+0000 7fa1cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 0x7fa1c404f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.446+0000 7fa1cb400640 1 -- 172.21.15.81:0/3712191478 learned_addr learned my addr 172.21.15.81:0/3712191478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.447+0000 7fa1d0a00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40d4910 con 0x7fa1c40da540 2024-09-11T01:07:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.447+0000 7fa1d0a00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40457e0 con 0x7fa1c40d4530 2024-09-11T01:07:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.447+0000 7fa1d0a00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c4050800 con 0x7fa1c4044fc0 2024-09-11T01:07:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.448+0000 7fa1cbe00640 1 -- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 msgr2=0x7fa1c4181600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1caa00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c416ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1cbe00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1cbe00640 1 -- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 msgr2=0x7fa1c416ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1cbe00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c416ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1cbe00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c40d5d10 con 0x7fa1c40da540 2024-09-11T01:07:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1cb400640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.449+0000 7fa1caa00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c416ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:07:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.450+0000 7fa1cbe00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 0x7fa1c404f260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc069fd0 tx=0x7fa1cc06ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.451+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc06a440 con 0x7fa1c40da540 2024-09-11T01:07:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.451+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1cc095440 con 0x7fa1c40da540 2024-09-11T01:07:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.451+0000 7fa1d0a00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c40d5a70 con 0x7fa1c40da540 2024-09-11T01:07:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.457+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc095890 con 0x7fa1c40da540 2024-09-11T01:07:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.457+0000 7fa1d0a00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c404ec20 con 0x7fa1c40da540 2024-09-11T01:07:06.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.459+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a0005290 con 0x7fa1c40da540 2024-09-11T01:07:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.460+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa1cc093070 con 0x7fa1c40da540 2024-09-11T01:07:06.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.462+0000 7fa1bf400640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 0x7fa1ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.463+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa1cc114020 con 0x7fa1c40da540 2024-09-11T01:07:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.463+0000 7fa1cb400640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 0x7fa1ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.464+0000 7fa1cb400640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 0x7fa1ac07a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007320 tx=0x7fa1c0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:06.472+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa1cc11d070 con 0x7fa1c40da540 2024-09-11T01:07:07.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.033+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1a0005580 con 0x7fa1c40da540 2024-09-11T01:07:07.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:07:07.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:07:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.035+0000 7fa1bf400640 1 -- 172.21.15.81:0/3712191478 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fa1cc0de730 con 0x7fa1c40da540 2024-09-11T01:07:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 msgr2=0x7fa1ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 0x7fa1ac07a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0007320 tx=0x7fa1c0004730 comp rx=0 tx=0).stop 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 msgr2=0x7fa1c404f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 0x7fa1c404f260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc069fd0 tx=0x7fa1cc06ae50 comp rx=0 tx=0).stop 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 shutdown_connections 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa1ac077f70 0x7fa1ac07a430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c40da540 0x7fa1c404f260 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c40d4530 0x7fa1c416ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.043+0000 7fa1bcc00640 1 --2- 172.21.15.81:0/3712191478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1c4044fc0 0x7fa1c4181600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.044+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 >> 172.21.15.81:0/3712191478 conn(0x7fa1c404fc00 msgr2=0x7fa1c404c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.048+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 shutdown_connections 2024-09-11T01:07:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.048+0000 7fa1bcc00640 1 -- 172.21.15.81:0/3712191478 wait complete. 2024-09-11T01:07:07.085 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-11T01:07:07.085 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-11T01:07:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.453+0000 7f8a37200640 1 -- 172.21.15.81:0/1858045065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a380701b0 msgr2=0x7f8a3815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.453+0000 7f8a37200640 1 --2- 172.21.15.81:0/1858045065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a380701b0 0x7f8a3815abd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8a380c2fe0 tx=0x7f8a2802a5d0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.455+0000 7f8a37200640 1 -- 172.21.15.81:0/1858045065 shutdown_connections 2024-09-11T01:07:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.455+0000 7f8a37200640 1 --2- 172.21.15.81:0/1858045065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a380701b0 0x7f8a3815abd0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.455+0000 7f8a37200640 1 --2- 172.21.15.81:0/1858045065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a3806fdd0 0x7f8a3815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.455+0000 7f8a37200640 1 -- 172.21.15.81:0/1858045065 >> 172.21.15.81:0/1858045065 conn(0x7f8a380cbe00 msgr2=0x7f8a380cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.456+0000 7f8a37200640 1 -- 172.21.15.81:0/1858045065 shutdown_connections 2024-09-11T01:07:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.456+0000 7f8a37200640 1 -- 172.21.15.81:0/1858045065 wait complete. 2024-09-11T01:07:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.460+0000 7f8a37200640 1 Processor -- start 2024-09-11T01:07:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.462+0000 7f8a37200640 1 -- start start 2024-09-11T01:07:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 0x7f8a381f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a380709d0 0x7f8a38073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a380707e0 con 0x7f8a3806fdd0 2024-09-11T01:07:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38070660 con 0x7f8a380701b0 2024-09-11T01:07:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.468+0000 7f8a37200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a380c71f0 con 0x7f8a380709d0 2024-09-11T01:07:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.469+0000 7f8a35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.469+0000 7f8a35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:47886/0 (socket says 172.21.15.81:47886) 2024-09-11T01:07:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.469+0000 7f8a35400640 1 -- 172.21.15.81:0/3132286420 learned_addr learned my addr 172.21.15.81:0/3132286420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.469+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 0x7f8a381f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 -- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a380709d0 msgr2=0x7f8a38073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a380709d0 0x7f8a38073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 -- 172.21.15.81:0/3132286420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 msgr2=0x7f8a381f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 0x7f8a381f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 -- 172.21.15.81:0/3132286420 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a381f54d0 con 0x7f8a380701b0 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 0x7f8a381f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.470+0000 7f8a35400640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000ba50 tx=0x7f8a2000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.471+0000 7f8a2e000640 1 -- 172.21.15.81:0/3132286420 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20019070 con 0x7f8a380701b0 2024-09-11T01:07:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.471+0000 7f8a2e000640 1 -- 172.21.15.81:0/3132286420 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a2000cca0 con 0x7f8a380701b0 2024-09-11T01:07:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.471+0000 7f8a2e000640 1 -- 172.21.15.81:0/3132286420 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a200146a0 con 0x7f8a380701b0 2024-09-11T01:07:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.471+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a381f57b0 con 0x7f8a380701b0 2024-09-11T01:07:07.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.471+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a38072700 con 0x7f8a380701b0 2024-09-11T01:07:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.474+0000 7f8a2e000640 1 -- 172.21.15.81:0/3132286420 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a2001d3b0 con 0x7f8a380701b0 2024-09-11T01:07:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.475+0000 7f8a2e000640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 0x7f8a1407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.476+0000 7f8a2e000640 1 -- 172.21.15.81:0/3132286420 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8a2009a120 con 0x7f8a380701b0 2024-09-11T01:07:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.476+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 0x7f8a1407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.477+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 0x7f8a1407a460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006fd0 tx=0x7f8a30008040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.484+0000 7f8a3fe0a740 1 Processor -- start 2024-09-11T01:07:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.484+0000 7f8a3fe0a740 1 -- start start 2024-09-11T01:07:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.485+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.486+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.487+0000 7f8a35e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.487+0000 7f8a35e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:47892/0 (socket says 172.21.15.81:47892) 2024-09-11T01:07:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.488+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e6a10 0x5647089eb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.488+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56470895e240 con 0x5647089e9b50 2024-09-11T01:07:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.488+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56470894d670 con 0x5647089e91b0 2024-09-11T01:07:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.488+0000 7f8a35e00640 1 -- 172.21.15.81:0/4110092505 learned_addr learned my addr 172.21.15.81:0/4110092505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.488+0000 7f8a36800640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e6a10 0x5647089eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.489+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x564708951480 con 0x5647089e6a10 2024-09-11T01:07:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.489+0000 7f8a35400640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35e00640 1 -- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e6a10 msgr2=0x5647089eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35e00640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e6a10 0x5647089eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35e00640 1 -- 172.21.15.81:0/4110092505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 msgr2=0x5647089eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35e00640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35e00640 1 -- 172.21.15.81:0/4110092505 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564708727de0 con 0x5647089e91b0 2024-09-11T01:07:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.490+0000 7f8a35400640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.491+0000 7f8a35e00640 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009730 tx=0x7f8a30010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724555d282f743ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.491+0000 7f8a26a00640 1 -- 172.21.15.81:0/4110092505 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30024070 con 0x5647089e91b0 2024-09-11T01:07:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.491+0000 7f8a26a00640 1 -- 172.21.15.81:0/4110092505 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30014bc0 con 0x5647089e91b0 2024-09-11T01:07:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.491+0000 7f8a26a00640 1 -- 172.21.15.81:0/4110092505 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001f400 con 0x5647089e91b0 2024-09-11T01:07:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.494+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 msgr2=0x5647089e64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.495+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009730 tx=0x7f8a30010000 comp rx=0 tx=0).stop 2024-09-11T01:07:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.495+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 shutdown_connections 2024-09-11T01:07:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.495+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e6a10 0x5647089eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.495+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.496+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/4110092505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089e64d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.497+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 >> 172.21.15.81:0/4110092505 conn(0x5647089e7350 msgr2=0x5647089e8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.498+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 shutdown_connections 2024-09-11T01:07:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.498+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/4110092505 wait complete. 2024-09-11T01:07:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.499+0000 7f8a3fe0a740 1 -- start start 2024-09-11T01:07:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.499+0000 7f8a3fe0a740 1 Processor -- start 2024-09-11T01:07:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.501+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e91b0 0x564708a2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.501+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x564708a15520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.501+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647086bdd20 con 0x5647089e9b50 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647088f2dd0 con 0x564708a28270 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5647089e5e10 con 0x5647089e91b0 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a3fe0a740 10 client.0 _ll_register_callbacks cb 0x56470865b1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a36800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a36800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:47902/0 (socket says 172.21.15.81:47902) 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a36800640 1 -- 172.21.15.81:0/3155716330 learned_addr learned my addr 172.21.15.81:0/3155716330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a35400640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x564708a15520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.502+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e91b0 0x564708a2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.503+0000 7f8a36800640 1 -- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e91b0 msgr2=0x564708a2abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.503+0000 7f8a36800640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e91b0 0x564708a2abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.503+0000 7f8a36800640 1 -- 172.21.15.81:0/3155716330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 msgr2=0x564708a15520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.503+0000 7f8a36800640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x564708a15520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.503+0000 7f8a36800640 1 -- 172.21.15.81:0/3155716330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564708788570 con 0x564708a28270 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.504+0000 7f8a36800640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009850 tx=0x7f8a280042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded37a16a09e84b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.504+0000 7f8a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:07:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.504+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28035040 con 0x564708a28270 2024-09-11T01:07:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.504+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8a280037f0 con 0x564708a28270 2024-09-11T01:07:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.505+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564708966700 con 0x564708a28270 2024-09-11T01:07:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.505+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8a280039f0 con 0x564708a28270 2024-09-11T01:07:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.508+0000 7f8a3fe0a740 10 client.5635 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.508+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56470868cc80 con 0x564708a28270 2024-09-11T01:07:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.509+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564708966700 con 0x564708a28270 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.509+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8a2803c440 con 0x564708a28270 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 10 client.5635 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 10 client.5635 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 20 client.5635 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a3bd80 0x564708a1d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 4 client.5635 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564708960190 con 0x564708a3bd80 2024-09-11T01:07:07.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.510+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a3bd80 0x564708a1d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.511+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a3bd80 0x564708a1d200 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c40bd756baa0dc16 server_cookie=2b2854de9d171362 in_seq=0 out_seq=0 2024-09-11T01:07:07.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.511+0000 7f8a1b400640 10 client.5635 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.513+0000 7f8a1b400640 1 -- 172.21.15.81:0/3155716330 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564708960190 con 0x564708a3bd80 2024-09-11T01:07:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.513+0000 7f8a1b400640 10 client.5635 handle_command_reply: tid=0 2024-09-11T01:07:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.513+0000 7f8a3fe0a740 1 client.5635 shutdown 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.513+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 msgr2=0x564708a15a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.513+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009850 tx=0x7f8a280042e0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 shutdown_connections 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a3bd80 0x564708a1d200 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708a15a60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x564708a15520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3155716330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e91b0 0x564708a2abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 >> 172.21.15.81:0/3155716330 conn(0x5647089e6a10 msgr2=0x564708a1f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a1b400640 0 client.5635 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:07.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 shutdown_connections 2024-09-11T01:07:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.514+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3155716330 wait complete. 2024-09-11T01:07:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.515+0000 7f8a3fe0a740 20 client.5635 trim_cache size 0 max 16384 2024-09-11T01:07:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.553+0000 7f8a3fe0a740 1 Processor -- start 2024-09-11T01:07:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.555+0000 7f8a3fe0a740 1 -- start start 2024-09-11T01:07:07.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.560+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.561+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.562+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 0x564708a1cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.562+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000ed10 con 0x5647089e9b50 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.563+0000 7f8a35400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.564+0000 7f8a35400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56088/0 (socket says 172.21.15.81:56088) 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.564+0000 7f8a35400640 1 -- 172.21.15.81:0/1615220963 learned_addr learned my addr 172.21.15.81:0/1615220963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.561+0000 7f8a35e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.564+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000dbf0 con 0x5647089e91b0 2024-09-11T01:07:07.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.564+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1000c110 con 0x564708a28270 2024-09-11T01:07:07.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.564+0000 7f8a36800640 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 0x564708a1cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.565+0000 7f8a36800640 1 -- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 msgr2=0x5647089ea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.565+0000 7f8a36800640 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089ea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.565+0000 7f8a36800640 1 -- 172.21.15.81:0/1615220963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 msgr2=0x5647089eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.566+0000 7f8a36800640 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.566+0000 7f8a36800640 1 -- 172.21.15.81:0/1615220963 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647089ea2a0 con 0x564708a28270 2024-09-11T01:07:07.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.567+0000 7f8a35400640 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.569+0000 7f8a36800640 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 0x564708a1cfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a28005c40 tx=0x7f8a28004350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a56f5827ce8f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.571+0000 7f8a26000640 1 -- 172.21.15.81:0/1615220963 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28035030 con 0x564708a28270 2024-09-11T01:07:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.571+0000 7f8a26000640 1 -- 172.21.15.81:0/1615220963 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a2803c940 con 0x564708a28270 2024-09-11T01:07:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.571+0000 7f8a26000640 1 -- 172.21.15.81:0/1615220963 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28003850 con 0x564708a28270 2024-09-11T01:07:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.572+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 msgr2=0x564708a1cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.572+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 0x564708a1cfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a28005c40 tx=0x7f8a28004350 comp rx=0 tx=0).stop 2024-09-11T01:07:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.573+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 shutdown_connections 2024-09-11T01:07:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.573+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564708a28270 0x564708a1cfd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.573+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e9b50 0x5647089eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.573+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/1615220963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647089e91b0 0x5647089ea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.573+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 >> 172.21.15.81:0/1615220963 conn(0x5647089e6a10 msgr2=0x5647089e8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.575+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 shutdown_connections 2024-09-11T01:07:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.575+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/1615220963 wait complete. 2024-09-11T01:07:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.581+0000 7f8a3fe0a740 1 -- start start 2024-09-11T01:07:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.582+0000 7f8a3fe0a740 1 Processor -- start 2024-09-11T01:07:07.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.586+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 0x564708aafcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.587+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.587+0000 7f8a3fe0a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708aa63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.588+0000 7f8a35400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a35400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:34372/0 (socket says 172.21.15.81:34372) 2024-09-11T01:07:07.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000c780 con 0x5647089e91b0 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1000d520 con 0x564708a28270 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a3fe0a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1000ce50 con 0x5647089e9b50 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a3fe0a740 10 client.0 _ll_register_callbacks cb 0x7f8a28005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.589+0000 7f8a35400640 1 -- 172.21.15.81:0/3884781326 learned_addr learned my addr 172.21.15.81:0/3884781326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.590+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 0x564708aafcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.590+0000 7f8a36800640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708aa63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35400640 1 -- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 msgr2=0x564708aa63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35400640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708aa63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35400640 1 -- 172.21.15.81:0/3884781326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 msgr2=0x564708aafcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:07.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35400640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 0x564708aafcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35400640 1 -- 172.21.15.81:0/3884781326 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5647089e8800 con 0x5647089e9b50 2024-09-11T01:07:07.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 0x564708aafcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:07:07.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.591+0000 7f8a36800640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708aa63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:07.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.592+0000 7f8a35400640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a200620b0 tx=0x7f8a20020040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce760a1e154faaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:07.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.592+0000 7f8a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T01:07:07.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.592+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20096060 con 0x5647089e9b50 2024-09-11T01:07:07.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.593+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8a2005da70 con 0x5647089e9b50 2024-09-11T01:07:07.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.593+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2803c940 con 0x5647089e9b50 2024-09-11T01:07:07.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.596+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8a2007b070 con 0x5647089e9b50 2024-09-11T01:07:07.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.596+0000 7f8a3fe0a740 10 client.5396 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:07.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.596+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564708a50660 con 0x5647089e9b50 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a2803c940 con 0x5647089e9b50 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8a20085070 con 0x5647089e9b50 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 10 client.5396 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 10 client.5396 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 20 client.5396 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a17ea0 0x564708aa68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:07.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 4 client.5396 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-11T01:07:07.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.597+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x564708a1eb60 con 0x564708a17ea0 2024-09-11T01:07:07.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.598+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a17ea0 0x564708aa68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:07.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.599+0000 7f8a35e00640 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a17ea0 0x564708aa68e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95422573fe4b942d server_cookie=f2ec8e5e453f4e22 in_seq=0 out_seq=0 2024-09-11T01:07:07.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.599+0000 7f8a1b400640 10 client.5396 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:07.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.747+0000 7f8a1b400640 1 -- 172.21.15.81:0/3884781326 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564708a1eb60 con 0x564708a17ea0 2024-09-11T01:07:07.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.747+0000 7f8a1b400640 10 client.5396 handle_command_reply: tid=0 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.747+0000 7f8a3fe0a740 1 client.5396 shutdown 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.747+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 msgr2=0x5647089eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.747+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a200620b0 tx=0x7f8a20020040 comp rx=0 tx=0).stop 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 shutdown_connections 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x564708a17ea0 0x564708aa68e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564708a28270 0x564708aa63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5647089e9b50 0x5647089eaf00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 --2- 172.21.15.81:0/3884781326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647089e91b0 0x564708aafcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a1b400640 0 client.5396 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 >> 172.21.15.81:0/3884781326 conn(0x5647089e6a10 msgr2=0x564708a4e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 shutdown_connections 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 1 -- 172.21.15.81:0/3884781326 wait complete. 2024-09-11T01:07:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a3fe0a740 20 client.5396 trim_cache size 0 max 16384 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 74, 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "80caf5be": { 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 74, 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:07.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 138.8, 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:07.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:07:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 msgr2=0x7f8a1407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.748+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 0x7f8a1407a460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006fd0 tx=0x7f8a30008040 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 msgr2=0x7f8a380731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000ba50 tx=0x7f8a2000bf10 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 shutdown_connections 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8a14077fa0 0x7f8a1407a460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a380709d0 0x7f8a38073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a380701b0 0x7f8a380731e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 --2- 172.21.15.81:0/3132286420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3806fdd0 0x7f8a381f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 >> 172.21.15.81:0/3132286420 conn(0x7f8a380cbe00 msgr2=0x7f8a3815a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 shutdown_connections 2024-09-11T01:07:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:07.749+0000 7f8a37200640 1 -- 172.21.15.81:0/3132286420 wait complete. 2024-09-11T01:07:07.765 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '80caf5be', quiesce took 1.7 seconds. Will release after: 17.150000000000002 2024-09-11T01:07:24.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:07:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 -- 172.21.15.81:0/1608229222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558151490 msgr2=0x7f35580cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 --2- 172.21.15.81:0/1608229222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558151490 0x7f35580cd220 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f35580ca9f0 tx=0x7f354c02aa10 comp rx=0 tx=0).stop 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 -- 172.21.15.81:0/1608229222 shutdown_connections 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 --2- 172.21.15.81:0/1608229222 >> v2:172.21.15.167:3300/0 conn(0x7f35580c7910 0x7f35580cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 --2- 172.21.15.81:0/1608229222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558151490 0x7f35580cd220 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 -- 172.21.15.81:0/1608229222 >> 172.21.15.81:0/1608229222 conn(0x7f355806f1f0 msgr2=0x7f355806f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 -- 172.21.15.81:0/1608229222 shutdown_connections 2024-09-11T01:07:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.085+0000 7f355e800640 1 -- 172.21.15.81:0/1608229222 wait complete. 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.087+0000 7f355e800640 1 Processor -- start 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 -- start start 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580c7910 0x7f35580c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3558151490 0x7f3558143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3558075020 con 0x7f3558074070 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3558074d40 con 0x7f3558151490 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.088+0000 7f355e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3558151870 con 0x7f35580c7910 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49774/0 (socket says 172.21.15.81:49774) 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 -- 172.21.15.81:0/283812491 learned_addr learned my addr 172.21.15.81:0/283812491 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355ca00640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580c7910 0x7f35580c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355de00640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3558151490 0x7f3558143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 -- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580c7910 msgr2=0x7f35580c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580c7910 0x7f35580c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 -- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3558151490 msgr2=0x7f3558143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3558151490 0x7f3558143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.089+0000 7f355d400640 1 -- 172.21.15.81:0/283812491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3558151dc0 con 0x7f3558074070 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f355d400640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f354c009d60 tx=0x7f354c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c033050 con 0x7f3558074070 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f354c004550 con 0x7f3558074070 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35581f0400 con 0x7f3558074070 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c038450 con 0x7f3558074070 2024-09-11T01:07:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.090+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35581f3ce0 con 0x7f3558074070 2024-09-11T01:07:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.091+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35581f01f0 con 0x7f3558074070 2024-09-11T01:07:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.092+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f354c040070 con 0x7f3558074070 2024-09-11T01:07:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.093+0000 7f3555600640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 0x7f353807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.093+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f354c0bb4d0 con 0x7f3558074070 2024-09-11T01:07:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.094+0000 7f355ca00640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 0x7f353807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.095+0000 7f355ca00640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 0x7f353807a460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35581445e0 tx=0x7f354400a2d0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.098+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f354c083bc0 con 0x7f3558074070 2024-09-11T01:07:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.315+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3558157cc0 con 0x7f3558074070 2024-09-11T01:07:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.315+0000 7f3555600640 1 -- 172.21.15.81:0/283812491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f354c0834c0 con 0x7f3558074070 2024-09-11T01:07:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:07:25.318 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:07:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:07:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 msgr2=0x7f353807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 0x7f353807a460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f35581445e0 tx=0x7f354400a2d0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 msgr2=0x7f35581f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f354c009d60 tx=0x7f354c003f90 comp rx=0 tx=0).stop 2024-09-11T01:07:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 shutdown_connections 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3538077fa0 0x7f353807a460 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3558151490 0x7f3558143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35580c7910 0x7f35580c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 --2- 172.21.15.81:0/283812491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3558074070 0x7f35581f37a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 >> 172.21.15.81:0/283812491 conn(0x7f355806f1f0 msgr2=0x7f355814e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 shutdown_connections 2024-09-11T01:07:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.318+0000 7f355e800640 1 -- 172.21.15.81:0/283812491 wait complete. 2024-09-11T01:07:25.336 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 80caf5be --release --await' 2024-09-11T01:07:25.336 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 80caf5be --release --await 2024-09-11T01:07:25.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:25.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:25.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 -- 172.21.15.81:0/2166225006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 msgr2=0x7f0ae00cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2166225006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae00cd400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8005fd0 tx=0x7f0ad802a960 comp rx=0 tx=0).stop 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 -- 172.21.15.81:0/2166225006 shutdown_connections 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2166225006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae00cd400 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 -- 172.21.15.81:0/2166225006 >> 172.21.15.81:0/2166225006 conn(0x7f0ae0068d00 msgr2=0x7f0ae0069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 -- 172.21.15.81:0/2166225006 shutdown_connections 2024-09-11T01:07:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.507+0000 7f0ae6600640 1 -- 172.21.15.81:0/2166225006 wait complete. 2024-09-11T01:07:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.509+0000 7f0ae6600640 1 Processor -- start 2024-09-11T01:07:25.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.510+0000 7f0ae6600640 1 -- start start 2024-09-11T01:07:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 0x7f0ae015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae01581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae006cd90 con 0x7f0ae015daf0 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae015e960 con 0x7f0ae00ccff0 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae6600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae006d070 con 0x7f0ae00c9ca0 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae01581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49784/0 (socket says 172.21.15.81:49784) 2024-09-11T01:07:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae5c00640 1 -- 172.21.15.81:0/2778648953 learned_addr learned my addr 172.21.15.81:0/2778648953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.511+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 0x7f0ae015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 -- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 msgr2=0x7f0ae015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 0x7f0ae015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 -- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 msgr2=0x7f0ae01581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae01581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 -- 172.21.15.81:0/2778648953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae01586e0 con 0x7f0ae015daf0 2024-09-11T01:07:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 0x7f0ae015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.512+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ad802af50 tx=0x7f0ad8039560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.513+0000 7f0adcc00640 1 -- 172.21.15.81:0/2778648953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8039b60 con 0x7f0ae015daf0 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.513+0000 7f0adcc00640 1 -- 172.21.15.81:0/2778648953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ad8039d00 con 0x7f0ae015daf0 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.513+0000 7f0adcc00640 1 -- 172.21.15.81:0/2778648953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad803b670 con 0x7f0ae015daf0 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.513+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae00c3d00 con 0x7f0ae015daf0 2024-09-11T01:07:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.513+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae01f0c80 con 0x7f0ae015daf0 2024-09-11T01:07:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.516+0000 7f0adcc00640 1 -- 172.21.15.81:0/2778648953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0ad8030070 con 0x7f0ae015daf0 2024-09-11T01:07:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.517+0000 7f0adcc00640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 0x7f0ac007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.517+0000 7f0adcc00640 1 -- 172.21.15.81:0/2778648953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f0ad802e030 con 0x7f0ae015daf0 2024-09-11T01:07:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.517+0000 7f0aeaa26740 1 Processor -- start 2024-09-11T01:07:25.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.517+0000 7f0aeaa26740 1 -- start start 2024-09-11T01:07:25.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.517+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 0x7f0ac007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 0x55b1dff70e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff5d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 0x55b1dff5dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfe9a370 con 0x55b1dff25d90 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfe897a0 con 0x55b1dff67a20 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b1dfe8d5b0 con 0x55b1dff22b20 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 0x7f0ac007a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001860 tx=0x7f0ad40016d0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0ae5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 0x55b1dff70e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0ae5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 0x55b1dff70e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49790/0 (socket says 172.21.15.81:49790) 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff5d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0ae5200640 1 -- 172.21.15.81:0/1357574589 learned_addr learned my addr 172.21.15.81:0/1357574589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.518+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 0x55b1dff5dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 -- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 msgr2=0x55b1dff5dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 0x55b1dff5dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 -- 172.21.15.81:0/1357574589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 msgr2=0x55b1dff70e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 0x55b1dff70e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 -- 172.21.15.81:0/1357574589 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1dfe22010 con 0x55b1dff67a20 2024-09-11T01:07:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 0x55b1dff5dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0adfe00640 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff5d5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00c3490 tx=0x7f0acc001ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10da7598a9535a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0ad1600640 1 -- 172.21.15.81:0/1357574589 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0052e0 con 0x55b1dff67a20 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0ad1600640 1 -- 172.21.15.81:0/1357574589 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0acc018070 con 0x55b1dff67a20 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.519+0000 7f0ad1600640 1 -- 172.21.15.81:0/1357574589 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00f9c0 con 0x55b1dff67a20 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 -- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 msgr2=0x55b1dff5d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff5d5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00c3490 tx=0x7f0acc001ba0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 -- 172.21.15.81:0/1357574589 shutdown_connections 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff22b20 0x55b1dff5dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff5d5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/1357574589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff25d90 0x55b1dff70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 -- 172.21.15.81:0/1357574589 >> 172.21.15.81:0/1357574589 conn(0x55b1dff23f70 msgr2=0x55b1dff25450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 -- 172.21.15.81:0/1357574589 shutdown_connections 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.520+0000 7f0aeaa26740 1 -- 172.21.15.81:0/1357574589 wait complete. 2024-09-11T01:07:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.521+0000 7f0aeaa26740 1 -- start start 2024-09-11T01:07:25.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.521+0000 7f0aeaa26740 1 Processor -- start 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dff7b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfe30f70 con 0x55b1dff68bb0 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfe2f090 con 0x55b1dff67a20 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55b1dff63860 con 0x55b1dff25d90 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0aeaa26740 10 client.0 _ll_register_callbacks cb 0x55b1dfb98110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dff7b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0ae5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:59272/0 (socket says 172.21.15.81:59272) 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0adfe00640 1 -- 172.21.15.81:0/2462434250 learned_addr learned my addr 172.21.15.81:0/2462434250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.522+0000 7f0ae5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:56292/0 (socket says 172.21.15.81:56292) 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 -- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 msgr2=0x55b1dff62e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 -- 172.21.15.81:0/2462434250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 msgr2=0x55b1dff7b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dff7b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 -- 172.21.15.81:0/2462434250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1dfbebea0 con 0x55b1dff67a20 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001eb0 tx=0x7f0acc010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30fdf7841f5c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0ac6000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0052e0 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f0acc007220 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.523+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0acc018070 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0acc02f050 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 10 client.5659 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b1dfc64d30 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0acc018070 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f0acc032020 con 0x55b1dff67a20 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 10 client.5659 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 10 client.5659 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 20 client.5659 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7c3f0 0x55b1dff4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 4 client.5659 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1dfe9c2c0 con 0x55b1dff7c3f0 2024-09-11T01:07:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.524+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7c3f0 0x55b1dff4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.525+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7c3f0 0x55b1dff4fde0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3f90f97b93080e server_cookie=db39e3c6fe4e1de2 in_seq=0 out_seq=0 2024-09-11T01:07:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.525+0000 7f0ac6000640 10 client.5659 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0ac6000640 1 -- 172.21.15.81:0/2462434250 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1dfe9c2c0 con 0x55b1dff7c3f0 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0ac6000640 10 client.5659 handle_command_reply: tid=0 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 client.5659 shutdown 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 msgr2=0x55b1dff59fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001eb0 tx=0x7f0acc010d80 comp rx=0 tx=0).stop 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 shutdown_connections 2024-09-11T01:07:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7c3f0 0x55b1dff4fde0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dff7b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0ac6000640 0 client.5659 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff67a20 0x55b1dff59fd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2462434250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff62e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 >> 172.21.15.81:0/2462434250 conn(0x55b1dff22b20 msgr2=0x55b1dff21f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 shutdown_connections 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2462434250 wait complete. 2024-09-11T01:07:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.526+0000 7f0aeaa26740 20 client.5659 trim_cache size 0 max 16384 2024-09-11T01:07:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.544+0000 7f0aeaa26740 1 Processor -- start 2024-09-11T01:07:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.544+0000 7f0aeaa26740 1 -- start start 2024-09-11T01:07:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff6a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff68bb0 0x55b1dff23720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae01ff310 con 0x55b1dff67a20 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae01fe1f0 con 0x55b1dff68bb0 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae01f4990 con 0x55b1dff25d90 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.545+0000 7f0adfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49806/0 (socket says 172.21.15.81:49806) 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 -- 172.21.15.81:0/2838335731 learned_addr learned my addr 172.21.15.81:0/2838335731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff68bb0 0x55b1dff23720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0ae5200640 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff6a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 -- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 msgr2=0x55b1dff6a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff6a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 -- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff68bb0 msgr2=0x55b1dff23720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff68bb0 0x55b1dff23720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 -- 172.21.15.81:0/2838335731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1dff286e0 con 0x55b1dff67a20 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0adfe00640 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007a20 tx=0x7f0acc000e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4cdb23b85b2210 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0ad0c00640 1 -- 172.21.15.81:0/2838335731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0052e0 con 0x55b1dff67a20 2024-09-11T01:07:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0ad0c00640 1 -- 172.21.15.81:0/2838335731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0acc018070 con 0x55b1dff67a20 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.546+0000 7f0ad0c00640 1 -- 172.21.15.81:0/2838335731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0035f0 con 0x55b1dff67a20 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2838335731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 msgr2=0x55b1dff231e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007a20 tx=0x7f0acc000e40 comp rx=0 tx=0).stop 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2838335731 shutdown_connections 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff68bb0 0x55b1dff23720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff67a20 0x55b1dff231e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/2838335731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff25d90 0x55b1dff6a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2838335731 >> 172.21.15.81:0/2838335731 conn(0x55b1dff22b20 msgr2=0x55b1dff535d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2838335731 shutdown_connections 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.547+0000 7f0aeaa26740 1 -- 172.21.15.81:0/2838335731 wait complete. 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.548+0000 7f0aeaa26740 1 -- start start 2024-09-11T01:07:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.548+0000 7f0aeaa26740 1 Processor -- start 2024-09-11T01:07:25.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff25d90 0x55b1dffe82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff67a20 0x55b1dff7f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae01fcf30 con 0x55b1dff68bb0 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae01fdb20 con 0x55b1dff25d90 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae01fd450 con 0x55b1dff67a20 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0aeaa26740 10 client.0 _ll_register_callbacks cb 0x7f0ad4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49818/0 (socket says 172.21.15.81:49818) 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 -- 172.21.15.81:0/3119577112 learned_addr learned my addr 172.21.15.81:0/3119577112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff25d90 0x55b1dffe82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0adfe00640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff67a20 0x55b1dff7f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 -- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff67a20 msgr2=0x55b1dff7f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff67a20 0x55b1dff7f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 -- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff25d90 msgr2=0x55b1dffe82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff25d90 0x55b1dffe82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.549+0000 7f0ae5c00640 1 -- 172.21.15.81:0/3119577112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1dffe8820 con 0x55b1dff68bb0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ae5c00640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80804b0 tx=0x7f0ad80830d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0c662069d8e6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8082d50 con 0x55b1dff68bb0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f0ad808c200 con 0x55b1dff68bb0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0acc018070 con 0x55b1dff68bb0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0ad8031e20 con 0x55b1dff68bb0 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0aeaa26740 10 client.5805 fetch_fsmap learned FSMap version 9 2024-09-11T01:07:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b1dff78c80 con 0x55b1dff68bb0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0acc018070 con 0x55b1dff68bb0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.550+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f0ad806ab80 con 0x55b1dff68bb0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 10 client.5805 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 10 client.5805 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 20 client.5805 populate_metadata read hostname 'smithi081' 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7e8a0 0x55b1dff231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 4 client.5805 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "80caf5be", "release": true, "await": true}] 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "80caf5be", "release": true, "await": true}) -- 0x55b1dfe97d70 con 0x55b1dff7e8a0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.551+0000 7f0ae5200640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7e8a0 0x55b1dff231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.552+0000 7f0ae5200640 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7e8a0 0x55b1dff231e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2039e56af178e1 server_cookie=35992791dd85e07b in_seq=0 out_seq=0 2024-09-11T01:07:25.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.552+0000 7f0ac6000640 10 client.5805 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0ac6000640 1 -- 172.21.15.81:0/3119577112 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b1dfe97d70 con 0x55b1dff7e8a0 2024-09-11T01:07:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0ac6000640 10 client.5805 handle_command_reply: tid=0 2024-09-11T01:07:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 client.5805 shutdown 2024-09-11T01:07:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 msgr2=0x55b1dffe22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80804b0 tx=0x7f0ad80830d0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 shutdown_connections 2024-09-11T01:07:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55b1dff7e8a0 0x55b1dff231e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1dff68bb0 0x55b1dffe22d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b1dff67a20 0x55b1dff7f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0ac6000640 0 client.5805 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 --2- 172.21.15.81:0/3119577112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1dff25d90 0x55b1dffe82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 >> 172.21.15.81:0/3119577112 conn(0x55b1dff22b20 msgr2=0x55b1dff62b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.573+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 shutdown_connections 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.574+0000 7f0aeaa26740 1 -- 172.21.15.81:0/3119577112 wait complete. 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.574+0000 7f0aeaa26740 20 client.5805 trim_cache size 0 max 16384 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:07:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 76, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "80caf5be": { 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 76, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 138.8, 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:07:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:07:25.579 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 msgr2=0x7f0ac007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 0x7f0ac007a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001860 tx=0x7f0ad40016d0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 msgr2=0x7f0ae015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ad802af50 tx=0x7f0ad8039560 comp rx=0 tx=0).stop 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 shutdown_connections 2024-09-11T01:07:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f0ac0077fa0 0x7f0ac007a460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ae015daf0 0x7f0ae015cef0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ae00ccff0 0x7f0ae01581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 --2- 172.21.15.81:0/2778648953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ae00c9ca0 0x7f0ae015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 >> 172.21.15.81:0/2778648953 conn(0x7f0ae0068d00 msgr2=0x7f0ae00c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 shutdown_connections 2024-09-11T01:07:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:07:25.575+0000 7f0ae6600640 1 -- 172.21.15.81:0/2778648953 wait complete. 2024-09-11T01:07:25.599 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '80caf5be', total seconds elapsed: 19.6 2024-09-11T01:07:57.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:07:57.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:27.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:27.761 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:35.615 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:08:35.616 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:08:35.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:08:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.727+0000 7f5ef8e00640 1 -- 172.21.15.81:0/3204344310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef4070c10 msgr2=0x7f5ef4073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.727+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/3204344310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef4070c10 0x7f5ef4073b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4007350 tx=0x7f5ee402b230 comp rx=0 tx=0).stop 2024-09-11T01:08:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.728+0000 7f5ef8e00640 1 -- 172.21.15.81:0/3204344310 shutdown_connections 2024-09-11T01:08:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.728+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/3204344310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef4070c10 0x7f5ef4073b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.728+0000 7f5ef8e00640 1 -- 172.21.15.81:0/3204344310 >> 172.21.15.81:0/3204344310 conn(0x7f5ef40700f0 msgr2=0x7f5ef4070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.728+0000 7f5ef8e00640 1 -- 172.21.15.81:0/3204344310 shutdown_connections 2024-09-11T01:08:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.728+0000 7f5ef8e00640 1 -- 172.21.15.81:0/3204344310 wait complete. 2024-09-11T01:08:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.732+0000 7f5ef8e00640 1 Processor -- start 2024-09-11T01:08:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.732+0000 7f5ef8e00640 1 -- start start 2024-09-11T01:08:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef40c2f90 0x7f5ef406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ef41508b0 0x7f5ef40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40c8680 con 0x7f5ef4070c10 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4150c90 con 0x7f5ef40c2f90 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.734+0000 7f5ef8e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef40c8800 con 0x7f5ef41508b0 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.735+0000 7f5ef1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.736+0000 7f5ef1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54770/0 (socket says 172.21.15.81:54770) 2024-09-11T01:08:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.736+0000 7f5ef1e00640 1 -- 172.21.15.81:0/483867184 learned_addr learned my addr 172.21.15.81:0/483867184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.737+0000 7f5ef1e00640 1 -- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ef41508b0 msgr2=0x7f5ef40caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.737+0000 7f5ef1e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ef41508b0 0x7f5ef40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.737+0000 7f5ef1e00640 1 -- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef40c2f90 msgr2=0x7f5ef406deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:08:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.737+0000 7f5ef1e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef40c2f90 0x7f5ef406deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.738+0000 7f5ef1e00640 1 -- 172.21.15.81:0/483867184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef41f0fc0 con 0x7f5ef4070c10 2024-09-11T01:08:36.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.738+0000 7f5ef1e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c760 tx=0x7f5ee000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.739+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00050d0 con 0x7f5ef4070c10 2024-09-11T01:08:36.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.739+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ee0005270 con 0x7f5ef4070c10 2024-09-11T01:08:36.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.739+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000a640 con 0x7f5ef4070c10 2024-09-11T01:08:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.741+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef40ca5b0 con 0x7f5ef4070c10 2024-09-11T01:08:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.743+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef40ca2d0 con 0x7f5ef4070c10 2024-09-11T01:08:36.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.750+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ee000a7e0 con 0x7f5ef4070c10 2024-09-11T01:08:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.753+0000 7f5eea000640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 0x7f5ed407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.753+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef406cc30 con 0x7f5ef4070c10 2024-09-11T01:08:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.754+0000 7f5ef1400640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 0x7f5ed407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.760+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f5ee0097620 con 0x7f5ef4070c10 2024-09-11T01:08:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.763+0000 7f5ef1400640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 0x7f5ed407a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4034000 tx=0x7f5ee4004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:36.771+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ef406cc30 con 0x7f5ef4070c10 2024-09-11T01:08:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.309+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef4156640 con 0x7f5ef4070c10 2024-09-11T01:08:37.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:08:37.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:08:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:08:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.319+0000 7f5eea000640 1 -- 172.21.15.81:0/483867184 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f5ee0061bf0 con 0x7f5ef4070c10 2024-09-11T01:08:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 msgr2=0x7f5ed407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 0x7f5ed407a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4034000 tx=0x7f5ee4004730 comp rx=0 tx=0).stop 2024-09-11T01:08:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 msgr2=0x7f5ef406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c760 tx=0x7f5ee000cc20 comp rx=0 tx=0).stop 2024-09-11T01:08:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 shutdown_connections 2024-09-11T01:08:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5ed4077f70 0x7f5ed407a430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ef41508b0 0x7f5ef40caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef40c2f90 0x7f5ef406deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 --2- 172.21.15.81:0/483867184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef4070c10 0x7f5ef406d970 secure :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c760 tx=0x7f5ee000cc20 comp rx=0 tx=0).stop 2024-09-11T01:08:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.324+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 >> 172.21.15.81:0/483867184 conn(0x7f5ef40700f0 msgr2=0x7f5ef40704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.330+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 shutdown_connections 2024-09-11T01:08:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.330+0000 7f5ef8e00640 1 -- 172.21.15.81:0/483867184 wait complete. 2024-09-11T01:08:37.377 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:08:37.377 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:08:37.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.744+0000 7f76e2800640 1 -- 172.21.15.81:0/3699911631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 msgr2=0x7f76dc153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.744+0000 7f76e2800640 1 --2- 172.21.15.81:0/3699911631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc153dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f76d4005fd0 tx=0x7f76d402ab20 comp rx=0 tx=0).stop 2024-09-11T01:08:37.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 -- 172.21.15.81:0/3699911631 shutdown_connections 2024-09-11T01:08:37.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 --2- 172.21.15.81:0/3699911631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc153dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 --2- 172.21.15.81:0/3699911631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc1574f0 0x7f76dc0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 -- 172.21.15.81:0/3699911631 >> 172.21.15.81:0/3699911631 conn(0x7f76dc070030 msgr2=0x7f76dc070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 -- 172.21.15.81:0/3699911631 shutdown_connections 2024-09-11T01:08:37.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.749+0000 7f76e2800640 1 -- 172.21.15.81:0/3699911631 wait complete. 2024-09-11T01:08:37.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.760+0000 7f76e2800640 1 Processor -- start 2024-09-11T01:08:37.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.761+0000 7f76e2800640 1 -- start start 2024-09-11T01:08:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.765+0000 7f76e2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 0x7f76dc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.766+0000 7f76e2800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.766+0000 7f76e2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.767+0000 7f76e2800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc074930 con 0x7f76dc1574f0 2024-09-11T01:08:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.767+0000 7f76e2800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc15ab80 con 0x7f76dc0c16f0 2024-09-11T01:08:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.767+0000 7f76e2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc074ab0 con 0x7f76dc072590 2024-09-11T01:08:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.768+0000 7f76db400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 0x7f76dc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.768+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.768+0000 7f76daa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.769+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54778/0 (socket says 172.21.15.81:54778) 2024-09-11T01:08:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.769+0000 7f76dbe00640 1 -- 172.21.15.81:0/2029846076 learned_addr learned my addr 172.21.15.81:0/2029846076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.772+0000 7f76daa00640 1 -- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 msgr2=0x7f76dc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.772+0000 7f76daa00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 0x7f76dc150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.772+0000 7f76daa00640 1 -- 172.21.15.81:0/2029846076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 msgr2=0x7f76dc1479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.772+0000 7f76daa00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.772+0000 7f76daa00640 1 -- 172.21.15.81:0/2029846076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc0cb770 con 0x7f76dc0c16f0 2024-09-11T01:08:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.774+0000 7f76dbe00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.774+0000 7f76db400640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 0x7f76dc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.776+0000 7f76daa00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc1ed790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00e840 tx=0x7f76cc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.779+0000 7f76d3400640 1 -- 172.21.15.81:0/2029846076 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00cdc0 con 0x7f76dc0c16f0 2024-09-11T01:08:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.779+0000 7f76d3400640 1 -- 172.21.15.81:0/2029846076 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76cc017440 con 0x7f76dc0c16f0 2024-09-11T01:08:37.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.779+0000 7f76d3400640 1 -- 172.21.15.81:0/2029846076 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00cdc0 con 0x7f76dc0c16f0 2024-09-11T01:08:37.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.779+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc14c130 con 0x7f76dc0c16f0 2024-09-11T01:08:37.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.779+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc1ed270 con 0x7f76dc0c16f0 2024-09-11T01:08:37.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.791+0000 7f76d3400640 1 -- 172.21.15.81:0/2029846076 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f76cc015070 con 0x7f76dc0c16f0 2024-09-11T01:08:37.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.792+0000 7f76e5632740 1 Processor -- start 2024-09-11T01:08:37.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.793+0000 7f76d3400640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 0x7f76bc07a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.793+0000 7f76d3400640 1 -- 172.21.15.81:0/2029846076 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f76cc09a060 con 0x7f76dc0c16f0 2024-09-11T01:08:37.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.793+0000 7f76e5632740 1 -- start start 2024-09-11T01:08:37.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.794+0000 7f76dbe00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 0x7f76bc07a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d390 0x55f9c5a9ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5a9f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f9c5a12260 con 0x55f9c5ad4a30 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f9c5a01690 con 0x55f9c5a9d390 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55f9c5a054a0 con 0x55f9c5a9d770 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54792/0 (socket says 172.21.15.81:54792) 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.795+0000 7f76dbe00640 1 -- 172.21.15.81:0/4021445861 learned_addr learned my addr 172.21.15.81:0/4021445861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.796+0000 7f76dbe00640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 0x7f76bc07a660 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009a60 tx=0x7f76d4004ab0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.796+0000 7f76dbe00640 1 -- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 msgr2=0x55f9c5a9f1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.796+0000 7f76dbe00640 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5a9f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.796+0000 7f76dbe00640 1 -- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d390 msgr2=0x55f9c5a9ec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.796+0000 7f76dbe00640 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d390 0x55f9c5a9ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.797+0000 7f76dbe00640 1 -- 172.21.15.81:0/4021445861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9c57dbd80 con 0x55f9c5ad4a30 2024-09-11T01:08:37.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.798+0000 7f76dbe00640 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76d402cbb0 tx=0x7f76d4046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5356a04b6effd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.800+0000 7f76c7e00640 1 -- 172.21.15.81:0/4021445861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4048040 con 0x55f9c5ad4a30 2024-09-11T01:08:37.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.800+0000 7f76c7e00640 1 -- 172.21.15.81:0/4021445861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d4051070 con 0x55f9c5ad4a30 2024-09-11T01:08:37.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.800+0000 7f76c7e00640 1 -- 172.21.15.81:0/4021445861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d40045c0 con 0x55f9c5ad4a30 2024-09-11T01:08:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.801+0000 7f76e5632740 1 -- 172.21.15.81:0/4021445861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 msgr2=0x55f9c5ad4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.801+0000 7f76e5632740 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76d402cbb0 tx=0x7f76d4046000 comp rx=0 tx=0).stop 2024-09-11T01:08:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.802+0000 7f76e5632740 1 -- 172.21.15.81:0/4021445861 shutdown_connections 2024-09-11T01:08:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.802+0000 7f76e5632740 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5ad4eb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.802+0000 7f76e5632740 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5a9f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.802+0000 7f76e5632740 1 --2- 172.21.15.81:0/4021445861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d390 0x55f9c5a9ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.802+0000 7f76e5632740 1 -- 172.21.15.81:0/4021445861 >> 172.21.15.81:0/4021445861 conn(0x55f9c5a9b570 msgr2=0x55f9c5a9ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.803+0000 7f76e5632740 1 -- 172.21.15.81:0/4021445861 shutdown_connections 2024-09-11T01:08:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.803+0000 7f76e5632740 1 -- 172.21.15.81:0/4021445861 wait complete. 2024-09-11T01:08:37.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.804+0000 7f76e5632740 1 -- start start 2024-09-11T01:08:37.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.804+0000 7f76e5632740 1 Processor -- start 2024-09-11T01:08:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d770 0x55f9c5af3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5adef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f9c5771cc0 con 0x55f9c5ad4a30 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f9c59a6e60 con 0x55f9c5a9d770 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55f9c5ad0190 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.808+0000 7f76e5632740 10 client.0 _ll_register_callbacks cb 0x55f9c59ad030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.809+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.810+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:33698/0 (socket says 172.21.15.81:33698) 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.810+0000 7f76dbe00640 1 -- 172.21.15.81:0/1366880458 learned_addr learned my addr 172.21.15.81:0/1366880458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.811+0000 7f76dbe00640 1 -- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d770 msgr2=0x55f9c5af3360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.811+0000 7f76dbe00640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d770 0x55f9c5af3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.811+0000 7f76dbe00640 1 -- 172.21.15.81:0/1366880458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 msgr2=0x55f9c5adef50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:08:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.820+0000 7f76daa00640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5adef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.820+0000 7f76dbe00640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5adef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.821+0000 7f76dbe00640 1 -- 172.21.15.81:0/1366880458 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f9c583c510 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.821+0000 7f76daa00640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5adef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:08:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.823+0000 7f76dbe00640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009bf0 tx=0x7f76d40099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d0be17f3a10b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.823+0000 7f76c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T01:08:37.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.824+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4048040 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.828+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f76d404c610 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.829+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d4051070 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.833+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f76d4076050 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.833+0000 7f76e5632740 10 client.5423 fetch_fsmap learned FSMap version 9 2024-09-11T01:08:37.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.834+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9c5740c20 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.835+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d4051070 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.835+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f76d404b050 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 10 client.5423 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:08:37.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 10 client.5423 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:08:37.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 20 client.5423 populate_metadata read hostname 'smithi081' 2024-09-11T01:08:37.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ac8460 0x55f9c5ae0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 4 client.5423 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:37.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.840+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9c5a141b0 con 0x55f9c5ac8460 2024-09-11T01:08:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.842+0000 7f76db400640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ac8460 0x55f9c5ae0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.848+0000 7f76db400640 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ac8460 0x55f9c5ae0070 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3cdfee9c321fc8 server_cookie=aec15c1f760b800d in_seq=0 out_seq=0 2024-09-11T01:08:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.848+0000 7f76c4c00640 10 client.5423 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:08:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.854+0000 7f76c4c00640 1 -- 172.21.15.81:0/1366880458 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9c5a141b0 con 0x55f9c5ac8460 2024-09-11T01:08:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.854+0000 7f76c4c00640 10 client.5423 handle_command_reply: tid=0 2024-09-11T01:08:37.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.854+0000 7f76e5632740 1 client.5423 shutdown 2024-09-11T01:08:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.856+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 msgr2=0x55f9c5ad0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.857+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009bf0 tx=0x7f76d40099c0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.858+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 shutdown_connections 2024-09-11T01:08:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.858+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ac8460 0x55f9c5ae0070 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.860+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ac7fe0 0x55f9c5ad0770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.860+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ad4a30 0x55f9c5adef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.860+0000 7f76e5632740 1 --2- 172.21.15.81:0/1366880458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5a9d770 0x55f9c5af3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.860+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 >> 172.21.15.81:0/1366880458 conn(0x55f9c5a9d390 msgr2=0x55f9c5aa0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.860+0000 7f76c4c00640 0 client.5423 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:08:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.861+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 shutdown_connections 2024-09-11T01:08:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.862+0000 7f76e5632740 1 -- 172.21.15.81:0/1366880458 wait complete. 2024-09-11T01:08:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.865+0000 7f76e5632740 20 client.5423 trim_cache size 0 max 16384 2024-09-11T01:08:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.909+0000 7f76e5632740 1 Processor -- start 2024-09-11T01:08:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.909+0000 7f76e5632740 1 -- start start 2024-09-11T01:08:37.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5aa0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5a9c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f9c5ae17b0 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76b400ed20 con 0x55f9c5ad4a30 2024-09-11T01:08:37.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.910+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f76b400dc00 con 0x55f9c5a9d770 2024-09-11T01:08:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.912+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.912+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:45672/0 (socket says 172.21.15.81:45672) 2024-09-11T01:08:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.912+0000 7f76dbe00640 1 -- 172.21.15.81:0/243909606 learned_addr learned my addr 172.21.15.81:0/243909606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.912+0000 7f76daa00640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5a9c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.913+0000 7f76db400640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5aa0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.915+0000 7f76dbe00640 1 -- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 msgr2=0x55f9c5aa0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.915+0000 7f76dbe00640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5aa0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.915+0000 7f76dbe00640 1 -- 172.21.15.81:0/243909606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 msgr2=0x55f9c5a9c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.915+0000 7f76dbe00640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5a9c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.916+0000 7f76dbe00640 1 -- 172.21.15.81:0/243909606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9c5a956b0 con 0x55f9c5ad4a30 2024-09-11T01:08:37.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.916+0000 7f76daa00640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5a9c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:37.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.917+0000 7f76dbe00640 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76d4004410 tx=0x7f76d402b1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e032d2f6d468f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.919+0000 7f76c7400640 1 -- 172.21.15.81:0/243909606 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4048050 con 0x55f9c5ad4a30 2024-09-11T01:08:37.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.919+0000 7f76c7400640 1 -- 172.21.15.81:0/243909606 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d4051040 con 0x55f9c5ad4a30 2024-09-11T01:08:37.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.920+0000 7f76c7400640 1 -- 172.21.15.81:0/243909606 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4048050 con 0x55f9c5ad4a30 2024-09-11T01:08:37.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.920+0000 7f76e5632740 1 -- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 msgr2=0x55f9c5a9ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.920+0000 7f76e5632740 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76d4004410 tx=0x7f76d402b1a0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 -- 172.21.15.81:0/243909606 shutdown_connections 2024-09-11T01:08:37.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ad4a30 0x55f9c5a9ca30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5a9c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 --2- 172.21.15.81:0/243909606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5a9d770 0x55f9c5aa0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 -- 172.21.15.81:0/243909606 >> 172.21.15.81:0/243909606 conn(0x55f9c5a9d390 msgr2=0x55f9c5a94b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 -- 172.21.15.81:0/243909606 shutdown_connections 2024-09-11T01:08:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.921+0000 7f76e5632740 1 -- 172.21.15.81:0/243909606 wait complete. 2024-09-11T01:08:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.923+0000 7f76e5632740 1 -- start start 2024-09-11T01:08:37.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.924+0000 7f76e5632740 1 Processor -- start 2024-09-11T01:08:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5a9d770 0x55f9c5ace110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 0x55f9c5adffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76b400d530 con 0x55f9c5a9d770 2024-09-11T01:08:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76b400c120 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f76b400c790 con 0x55f9c5ad4a30 2024-09-11T01:08:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.928+0000 7f76e5632740 10 client.0 _ll_register_callbacks cb 0x7f76d4003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.929+0000 7f76daa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.930+0000 7f76daa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:45682/0 (socket says 172.21.15.81:45682) 2024-09-11T01:08:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.930+0000 7f76daa00640 1 -- 172.21.15.81:0/1444157614 learned_addr learned my addr 172.21.15.81:0/1444157614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:08:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.930+0000 7f76db400640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5a9d770 0x55f9c5ace110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.930+0000 7f76dbe00640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 0x55f9c5adffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76daa00640 1 -- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 msgr2=0x55f9c5adffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76daa00640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 0x55f9c5adffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76daa00640 1 -- 172.21.15.81:0/1444157614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5a9d770 msgr2=0x55f9c5ace110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76daa00640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5a9d770 0x55f9c5ace110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76daa00640 1 -- 172.21.15.81:0/1444157614 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9c5a9ce90 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.934+0000 7f76dbe00640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 0x55f9c5adffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.939+0000 7f76daa00640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f76cc062120 tx=0x7f76cc062670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c551f64bfad2781 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.940+0000 7f76c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-11T01:08:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.940+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0615f0 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.941+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f76cc05dae0 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.942+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d4051040 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.945+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f76cc062190 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.945+0000 7f76e5632740 10 client.5683 fetch_fsmap learned FSMap version 9 2024-09-11T01:08:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.945+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9c5aef9f0 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d4051040 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f76cc00b040 con 0x55f9c5ac7fe0 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 10 client.5683 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 10 client.5683 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 20 client.5683 populate_metadata read hostname 'smithi081' 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ad8f10 0x55f9c5ae0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 4 client.5683 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:08:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.947+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55f9c5a9bcd0 con 0x55f9c5ad8f10 2024-09-11T01:08:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.951+0000 7f76db400640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ad8f10 0x55f9c5ae0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.953+0000 7f76db400640 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ad8f10 0x55f9c5ae0510 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17a993689d736fa1 server_cookie=fd3b3d9983a930c2 in_seq=0 out_seq=0 2024-09-11T01:08:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:37.953+0000 7f76c4c00640 10 client.5683 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:08:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.266+0000 7f76c4c00640 1 -- 172.21.15.81:0/1444157614 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f9c5a9bcd0 con 0x55f9c5ad8f10 2024-09-11T01:08:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.266+0000 7f76c4c00640 10 client.5683 handle_command_reply: tid=0 2024-09-11T01:08:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 client.5683 shutdown 2024-09-11T01:08:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 msgr2=0x55f9c5b015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f76cc062120 tx=0x7f76cc062670 comp rx=0 tx=0).stop 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 shutdown_connections 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55f9c5ad8f10 0x55f9c5ae0510 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f9c5ad4a30 0x55f9c5adffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9c5ac7fe0 0x55f9c5b015f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 --2- 172.21.15.81:0/1444157614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9c5a9d770 0x55f9c5ace110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 >> 172.21.15.81:0/1444157614 conn(0x55f9c5a9d390 msgr2=0x55f9c5acf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76c4c00640 0 client.5683 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:08:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.267+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 shutdown_connections 2024-09-11T01:08:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.269+0000 7f76e5632740 1 -- 172.21.15.81:0/1444157614 wait complete. 2024-09-11T01:08:38.272 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:08:38.272 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:08:38.272 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:08:38.272 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 78, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "34bf8fff": { 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 78, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:08:38.273 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.269+0000 7f76e5632740 20 client.5683 trim_cache size 0 max 16384 2024-09-11T01:08:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.272+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 msgr2=0x7f76bc07a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.272+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 0x7f76bc07a660 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009a60 tx=0x7f76d4004ab0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.272+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 msgr2=0x7f76dc1ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.272+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc1ed790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00e840 tx=0x7f76cc00ed00 comp rx=0 tx=0).stop 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 shutdown_connections 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f76bc0781a0 0x7f76bc07a660 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76dc1574f0 0x7f76dc1479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc0c16f0 0x7f76dc1ed790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 --2- 172.21.15.81:0/2029846076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76dc072590 0x7f76dc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 >> 172.21.15.81:0/2029846076 conn(0x7f76dc070030 msgr2=0x7f76dc155580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 shutdown_connections 2024-09-11T01:08:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:08:38.273+0000 7f76e2800640 1 -- 172.21.15.81:0/2029846076 wait complete. 2024-09-11T01:08:38.300 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '34bf8fff', quiesce took 2.7 seconds. Will release after: 27.3 2024-09-11T01:08:59.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:08:59.835 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:05.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 -- 172.21.15.81:0/1958029003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40152610 msgr2=0x7f7c400c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 --2- 172.21.15.81:0/1958029003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40152610 0x7f7c400c0f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c40074fb0 tx=0x7f7c3002a8b0 comp rx=0 tx=0).stop 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 -- 172.21.15.81:0/1958029003 shutdown_connections 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 --2- 172.21.15.81:0/1958029003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c400c8680 0x7f7c40162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 --2- 172.21.15.81:0/1958029003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40152610 0x7f7c400c0f90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 -- 172.21.15.81:0/1958029003 >> 172.21.15.81:0/1958029003 conn(0x7f7c400700f0 msgr2=0x7f7c40070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 -- 172.21.15.81:0/1958029003 shutdown_connections 2024-09-11T01:09:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.770+0000 7f7c45600640 1 -- 172.21.15.81:0/1958029003 wait complete. 2024-09-11T01:09:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.772+0000 7f7c45600640 1 Processor -- start 2024-09-11T01:09:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.772+0000 7f7c45600640 1 -- start start 2024-09-11T01:09:05.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 0x7f7c4014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c40152610 0x7f7c401e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40070cf0 con 0x7f7c401f0e10 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4015c140 con 0x7f7c40074860 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c45600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7c400c8090 con 0x7f7c40152610 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58278/0 (socket says 172.21.15.81:58278) 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3f400640 1 -- 172.21.15.81:0/1365111389 learned_addr learned my addr 172.21.15.81:0/1365111389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3ea00640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 0x7f7c4014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3e000640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c40152610 0x7f7c401e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3f400640 1 -- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c40152610 msgr2=0x7f7c401e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.773+0000 7f7c3f400640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c40152610 0x7f7c401e1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c3f400640 1 -- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 msgr2=0x7f7c4014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c3f400640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 0x7f7c4014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c3f400640 1 -- 172.21.15.81:0/1365111389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c40159290 con 0x7f7c401f0e10 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c3ea00640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 0x7f7c4014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c3f400640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e970 tx=0x7f7c3800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800ccc0 con 0x7f7c401f0e10 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c3800ce60 con 0x7f7c401f0e10 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c40158730 con 0x7f7c401f0e10 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38005280 con 0x7f7c401f0e10 2024-09-11T01:09:05.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.774+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c40158cd0 con 0x7f7c401f0e10 2024-09-11T01:09:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.775+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c401529f0 con 0x7f7c401f0e10 2024-09-11T01:09:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.776+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7c38005420 con 0x7f7c401f0e10 2024-09-11T01:09:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.777+0000 7f7c36a00640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 0x7f7c2007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.777+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f7c3809aba0 con 0x7f7c401f0e10 2024-09-11T01:09:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.778+0000 7f7c3ea00640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 0x7f7c2007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.778+0000 7f7c3ea00640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 0x7f7c2007a460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034000 tx=0x7f7c30004ab0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:05.781+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7c38063320 con 0x7f7c401f0e10 2024-09-11T01:09:06.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.002+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c401f0750 con 0x7f7c401f0e10 2024-09-11T01:09:06.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.003+0000 7f7c36a00640 1 -- 172.21.15.81:0/1365111389 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f7c38062c20 con 0x7f7c401f0e10 2024-09-11T01:09:06.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:09:06.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:09:06.005 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:09:06.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 msgr2=0x7f7c2007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 0x7f7c2007a460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034000 tx=0x7f7c30004ab0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 msgr2=0x7f7c401f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e970 tx=0x7f7c3800ee30 comp rx=0 tx=0).stop 2024-09-11T01:09:06.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 shutdown_connections 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7c20077fa0 0x7f7c2007a460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c401f0e10 0x7f7c401f12c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c40152610 0x7f7c401e1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 --2- 172.21.15.81:0/1365111389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c40074860 0x7f7c4014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.005+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 >> 172.21.15.81:0/1365111389 conn(0x7f7c400700f0 msgr2=0x7f7c400c7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.006+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 shutdown_connections 2024-09-11T01:09:06.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.006+0000 7f7c45600640 1 -- 172.21.15.81:0/1365111389 wait complete. 2024-09-11T01:09:06.024 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 34bf8fff --release --await' 2024-09-11T01:09:06.024 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 34bf8fff --release --await 2024-09-11T01:09:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.192+0000 7f6789400640 1 -- 172.21.15.81:0/174948952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6784074280 msgr2=0x7f678415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.192+0000 7f6789400640 1 --2- 172.21.15.81:0/174948952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6784074280 0x7f678415b320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6784071920 tx=0x7f677402a5f0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 -- 172.21.15.81:0/174948952 shutdown_connections 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 --2- 172.21.15.81:0/174948952 >> v2:172.21.15.167:3300/0 conn(0x7f67840c1550 0x7f67840c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 --2- 172.21.15.81:0/174948952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c6ab0 0x7f67840c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 --2- 172.21.15.81:0/174948952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6784074280 0x7f678415b320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 -- 172.21.15.81:0/174948952 >> 172.21.15.81:0/174948952 conn(0x7f678406ff90 msgr2=0x7f67840703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 -- 172.21.15.81:0/174948952 shutdown_connections 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.193+0000 7f6789400640 1 -- 172.21.15.81:0/174948952 wait complete. 2024-09-11T01:09:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.194+0000 7f6789400640 1 Processor -- start 2024-09-11T01:09:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.194+0000 7f6789400640 1 -- start start 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6784074280 0x7f67840af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c1550 0x7f678414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f678406f880 con 0x7f67840c6ab0 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6784070e90 con 0x7f6784074280 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6789400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f678406fa00 con 0x7f67840c1550 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.195+0000 7f6783200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58302/0 (socket says 172.21.15.81:58302) 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 -- 172.21.15.81:0/3720371033 learned_addr learned my addr 172.21.15.81:0/3720371033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6782800640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6784074280 0x7f67840af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f677be00640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c1550 0x7f678414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 -- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c1550 msgr2=0x7f678414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c1550 0x7f678414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 -- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6784074280 msgr2=0x7f67840af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6784074280 0x7f67840af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 -- 172.21.15.81:0/3720371033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784157be0 con 0x7f67840c6ab0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6783200640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e980 tx=0x7f677c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f677aa00640 1 -- 172.21.15.81:0/3720371033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c004d20 con 0x7f67840c6ab0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f677aa00640 1 -- 172.21.15.81:0/3720371033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f677c00cb20 con 0x7f67840c6ab0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67841f0c90 con 0x7f67840c6ab0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.196+0000 7f677aa00640 1 -- 172.21.15.81:0/3720371033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c005020 con 0x7f67840c6ab0 2024-09-11T01:09:06.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.197+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841f1250 con 0x7f67840c6ab0 2024-09-11T01:09:06.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.199+0000 7f677aa00640 1 -- 172.21.15.81:0/3720371033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f677c00f040 con 0x7f67840c6ab0 2024-09-11T01:09:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.200+0000 7f677aa00640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 0x7f676007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.200+0000 7f677aa00640 1 -- 172.21.15.81:0/3720371033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f677c09a680 con 0x7f67840c6ab0 2024-09-11T01:09:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.200+0000 7f678c48b740 1 Processor -- start 2024-09-11T01:09:06.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.200+0000 7f678c48b740 1 -- start start 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.200+0000 7f6782800640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 0x7f676007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x55710032f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571002f4910 0x55710032f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55710026c370 con 0x5571002f7b80 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55710025b7a0 con 0x5571002f4910 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55710025f5b0 con 0x557100339810 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f6782800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f6782800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58314/0 (socket says 172.21.15.81:58314) 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f6782800640 1 -- 172.21.15.81:0/695875848 learned_addr learned my addr 172.21.15.81:0/695875848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f677be00640 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x55710032f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f6783200640 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571002f4910 0x55710032f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.201+0000 7f6782800640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 0x7f676007a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6774033000 tx=0x7f6774004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 -- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 msgr2=0x55710032f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x55710032f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 -- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571002f4910 msgr2=0x55710032f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571002f4910 0x55710032f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 -- 172.21.15.81:0/695875848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571001f4010 con 0x5571002f7b80 2024-09-11T01:09:06.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6782800640 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6774009850 tx=0x7f677403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36537c026cc22b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6773000640 1 -- 172.21.15.81:0/695875848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677404d070 con 0x5571002f7b80 2024-09-11T01:09:06.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6773000640 1 -- 172.21.15.81:0/695875848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6774003e30 con 0x5571002f7b80 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.202+0000 7f6773000640 1 -- 172.21.15.81:0/695875848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774035040 con 0x5571002f7b80 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 -- 172.21.15.81:0/695875848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 msgr2=0x557100342c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6774009850 tx=0x7f677403d000 comp rx=0 tx=0).stop 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 -- 172.21.15.81:0/695875848 shutdown_connections 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571002f4910 0x55710032f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x55710032f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 --2- 172.21.15.81:0/695875848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100342c20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 -- 172.21.15.81:0/695875848 >> 172.21.15.81:0/695875848 conn(0x5571002f5d60 msgr2=0x5571002f7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 -- 172.21.15.81:0/695875848 shutdown_connections 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.203+0000 7f678c48b740 1 -- 172.21.15.81:0/695875848 wait complete. 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.204+0000 7f678c48b740 1 -- start start 2024-09-11T01:09:06.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.204+0000 7f678c48b740 1 Processor -- start 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x557100343440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 0x5571003410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557100202f70 con 0x55710033e360 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557100201090 con 0x557100339810 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55710034e140 con 0x5571002f7b80 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f678c48b740 10 client.0 _ll_register_callbacks cb 0x5570fff6a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58320/0 (socket says 172.21.15.81:58320) 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 -- 172.21.15.81:0/1703251338 learned_addr learned my addr 172.21.15.81:0/1703251338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6782800640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x557100343440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f677be00640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 0x5571003410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 -- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 msgr2=0x557100343440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x557100343440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 -- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 msgr2=0x5571003410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 0x5571003410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 -- 172.21.15.81:0/1703251338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570fffbdea0 con 0x55710033e360 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f677be00640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 0x5571003410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6783200640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f677c05e7c0 tx=0x7f677c062d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d17c1dd91140a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.205+0000 7f6767400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c01f040 con 0x55710033e360 2024-09-11T01:09:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f677c088180 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6774003e30 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f677c0627b0 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 10 client.5844 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557100036d30 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6774003e30 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f677c092ca0 con 0x55710033e360 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 10 client.5844 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 10 client.5844 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 20 client.5844 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557100336dc0 0x557100349c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 4 client.5844 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.206+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55710026e2c0 con 0x557100336dc0 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.207+0000 7f6782800640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557100336dc0 0x557100349c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.208+0000 7f6782800640 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557100336dc0 0x557100349c80 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7038aef973b986 server_cookie=a09edea1b9dbb121 in_seq=0 out_seq=0 2024-09-11T01:09:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.208+0000 7f6767400640 10 client.5844 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.208+0000 7f6767400640 1 -- 172.21.15.81:0/1703251338 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55710026e2c0 con 0x557100336dc0 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.208+0000 7f6767400640 10 client.5844 handle_command_reply: tid=0 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.208+0000 7f678c48b740 1 client.5844 shutdown 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 msgr2=0x557100330f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f677c05e7c0 tx=0x7f677c062d50 comp rx=0 tx=0).stop 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 shutdown_connections 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557100336dc0 0x557100349c80 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55710033e360 0x557100330f70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557100339810 0x5571003410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 --2- 172.21.15.81:0/1703251338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x557100343440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f6767400640 0 client.5844 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 >> 172.21.15.81:0/1703251338 conn(0x5571002f4910 msgr2=0x5571002f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 shutdown_connections 2024-09-11T01:09:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 1 -- 172.21.15.81:0/1703251338 wait complete. 2024-09-11T01:09:06.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.209+0000 7f678c48b740 20 client.5844 trim_cache size 0 max 16384 2024-09-11T01:09:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.226+0000 7f678c48b740 1 Processor -- start 2024-09-11T01:09:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 -- start start 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x5571002f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x5571002f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67841ff390 con 0x5571002f7b80 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67841fe270 con 0x55710033e360 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.227+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f67840cb720 con 0x557100339810 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58322/0 (socket says 172.21.15.81:58322) 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 -- 172.21.15.81:0/1587793979 learned_addr learned my addr 172.21.15.81:0/1587793979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 -- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 msgr2=0x5571002f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x5571002f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6783200640 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x5571002f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 -- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 msgr2=0x5571002f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x5571002f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 -- 172.21.15.81:0/1587793979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557100344520 con 0x5571002f7b80 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6782800640 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f67740044a0 tx=0x7f67740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cbc36b29ea0816 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6772600640 1 -- 172.21.15.81:0/1587793979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774040070 con 0x5571002f7b80 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6772600640 1 -- 172.21.15.81:0/1587793979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6774052650 con 0x5571002f7b80 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.228+0000 7f6772600640 1 -- 172.21.15.81:0/1587793979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774035040 con 0x5571002f7b80 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 -- 172.21.15.81:0/1587793979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 msgr2=0x557100343fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f67740044a0 tx=0x7f67740046c0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 -- 172.21.15.81:0/1587793979 shutdown_connections 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x5571002f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557100339810 0x5571002f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 --2- 172.21.15.81:0/1587793979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571002f7b80 0x557100343fe0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 -- 172.21.15.81:0/1587793979 >> 172.21.15.81:0/1587793979 conn(0x5571002f4910 msgr2=0x5571002f6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 -- 172.21.15.81:0/1587793979 shutdown_connections 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.229+0000 7f678c48b740 1 -- 172.21.15.81:0/1587793979 wait complete. 2024-09-11T01:09:06.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.230+0000 7f678c48b740 1 -- start start 2024-09-11T01:09:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.230+0000 7f678c48b740 1 Processor -- start 2024-09-11T01:09:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x5571003c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x55710032f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67841fcf90 con 0x557100339810 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67841fdba0 con 0x55710033e360 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f67841fd510 con 0x5571002f7b80 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f678c48b740 10 client.0 _ll_register_callbacks cb 0x7f677c062580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58328/0 (socket says 172.21.15.81:58328) 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 -- 172.21.15.81:0/3324298019 learned_addr learned my addr 172.21.15.81:0/3324298019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f6782800640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x5571003c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f6783200640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x55710032f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 -- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 msgr2=0x5571003c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x5571003c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 -- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 msgr2=0x55710032f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x55710032f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.231+0000 7f677be00640 1 -- 172.21.15.81:0/3324298019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571002f4d90 con 0x557100339810 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f677be00640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b560 tx=0x7f676c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396ed36a50395a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bcd0 con 0x557100339810 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f676c005020 con 0x557100339810 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6774052650 con 0x557100339810 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f676c024050 con 0x557100339810 2024-09-11T01:09:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 10 client.5850 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5571002f5830 con 0x557100339810 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6774052650 con 0x557100339810 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f676c027020 con 0x557100339810 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 10 client.5850 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 10 client.5850 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 20 client.5850 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5571003c0b60 0x5571003c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 4 client.5850 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "34bf8fff", "release": true, "await": true}] 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.232+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "34bf8fff", "release": true, "await": true}) -- 0x557100269d70 con 0x5571003c0b60 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.233+0000 7f6782800640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5571003c0b60 0x5571003c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.233+0000 7f6782800640 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5571003c0b60 0x5571003c0f40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79278ac3c1722d2d server_cookie=b15a7eac92fd64e in_seq=0 out_seq=0 2024-09-11T01:09:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.233+0000 7f6767400640 10 client.5850 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f6767400640 1 -- 172.21.15.81:0/3324298019 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557100269d70 con 0x5571003c0b60 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f6767400640 10 client.5850 handle_command_reply: tid=0 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 client.5850 shutdown 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 msgr2=0x557100334c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b560 tx=0x7f676c003a80 comp rx=0 tx=0).stop 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 shutdown_connections 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5571003c0b60 0x5571003c0f40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55710033e360 0x55710032f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557100339810 0x557100334c30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 --2- 172.21.15.81:0/3324298019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571002f7b80 0x5571003c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 >> 172.21.15.81:0/3324298019 conn(0x5571002f4910 msgr2=0x5571002f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.257+0000 7f6767400640 0 client.5850 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.258+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 shutdown_connections 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.258+0000 7f678c48b740 1 -- 172.21.15.81:0/3324298019 wait complete. 2024-09-11T01:09:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.258+0000 7f678c48b740 20 client.5850 trim_cache size 0 max 16384 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 80, 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "34bf8fff": { 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 80, 2024-09-11T01:09:06.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:09:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:06.263 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 msgr2=0x7f676007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 0x7f676007a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6774033000 tx=0x7f6774004730 comp rx=0 tx=0).stop 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 msgr2=0x7f67841f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e980 tx=0x7f677c00ee40 comp rx=0 tx=0).stop 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 shutdown_connections 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6760077f70 0x7f676007a430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840c6ab0 0x7f67841f40e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67840c1550 0x7f678414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 --2- 172.21.15.81:0/3720371033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6784074280 0x7f67840af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 >> 172.21.15.81:0/3720371033 conn(0x7f678406ff90 msgr2=0x7f6784070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 shutdown_connections 2024-09-11T01:09:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.259+0000 7f6789400640 1 -- 172.21.15.81:0/3720371033 wait complete. 2024-09-11T01:09:06.282 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '34bf8fff', total seconds elapsed: 30.7 2024-09-11T01:09:06.282 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:09:06.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:09:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 -- 172.21.15.81:0/242145087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb290156640 msgr2=0x7fb2900c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 --2- 172.21.15.81:0/242145087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb290156640 0x7fb2900c2880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb288005fd0 tx=0x7fb28802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 -- 172.21.15.81:0/242145087 shutdown_connections 2024-09-11T01:09:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 --2- 172.21.15.81:0/242145087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb290156640 0x7fb2900c2880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 --2- 172.21.15.81:0/242145087 >> v2:172.21.15.81:3300/0 conn(0x7fb2900c8680 0x7fb2901508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.583+0000 7fb297a00640 1 -- 172.21.15.81:0/242145087 >> 172.21.15.81:0/242145087 conn(0x7fb2900700f0 msgr2=0x7fb290070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.586+0000 7fb297a00640 1 -- 172.21.15.81:0/242145087 shutdown_connections 2024-09-11T01:09:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.586+0000 7fb297a00640 1 -- 172.21.15.81:0/242145087 wait complete. 2024-09-11T01:09:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.589+0000 7fb297a00640 1 Processor -- start 2024-09-11T01:09:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.596+0000 7fb297a00640 1 -- start start 2024-09-11T01:09:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.602+0000 7fb297a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 0x7fb290200ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.603+0000 7fb297a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 0x7fb2900cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.604+0000 7fb297a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.606+0000 7fb297a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2900c2dc0 con 0x7fb2901fd0e0 2024-09-11T01:09:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.606+0000 7fb295a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.606+0000 7fb295a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:48152/0 (socket says 172.21.15.81:48152) 2024-09-11T01:09:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.606+0000 7fb295a00640 1 -- 172.21.15.81:0/1460571177 learned_addr learned my addr 172.21.15.81:0/1460571177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.607+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb290073650 con 0x7fb290070c10 2024-09-11T01:09:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.607+0000 7fb295000640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 0x7fb290200ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.608+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2900c2f40 con 0x7fb2901529d0 2024-09-11T01:09:06.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.609+0000 7fb28fe00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 0x7fb2900cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.611+0000 7fb295a00640 1 -- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 msgr2=0x7fb290200ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.611+0000 7fb295a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 0x7fb290200ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.611+0000 7fb295a00640 1 -- 172.21.15.81:0/1460571177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 msgr2=0x7fb2900cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.611+0000 7fb295a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 0x7fb2900cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.611+0000 7fb295a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29006f370 con 0x7fb2901529d0 2024-09-11T01:09:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.613+0000 7fb28fe00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 0x7fb2900cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.614+0000 7fb295000640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 0x7fb290200ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:06.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.614+0000 7fb295a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb288009cd0 tx=0x7fb288003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:06.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.616+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288031ba0 con 0x7fb2901529d0 2024-09-11T01:09:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.617+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29006e210 con 0x7fb2901529d0 2024-09-11T01:09:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.617+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb288031e30 con 0x7fb2901529d0 2024-09-11T01:09:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.617+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288033330 con 0x7fb2901529d0 2024-09-11T01:09:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.621+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2900b0c00 con 0x7fb2901529d0 2024-09-11T01:09:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.624+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2900c2880 con 0x7fb2901529d0 2024-09-11T01:09:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.634+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb2880334d0 con 0x7fb2901529d0 2024-09-11T01:09:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.639+0000 7fb28cc00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 0x7fb27007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.639+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb2880bbae0 con 0x7fb2901529d0 2024-09-11T01:09:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.639+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb288052080 con 0x7fb2901529d0 2024-09-11T01:09:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.641+0000 7fb295000640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 0x7fb27007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:06.643+0000 7fb295000640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 0x7fb27007a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb284007fd0 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.166+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2900704d0 con 0x7fb2901529d0 2024-09-11T01:09:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.172+0000 7fb28cc00640 1 -- 172.21.15.81:0/1460571177 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fb28803f030 con 0x7fb2901529d0 2024-09-11T01:09:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:09:07.174 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:09:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:09:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.176+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 msgr2=0x7fb27007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.176+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 0x7fb27007a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb284007fd0 tx=0x7fb284009040 comp rx=0 tx=0).stop 2024-09-11T01:09:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 msgr2=0x7fb290149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb288009cd0 tx=0x7fb288003ba0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 shutdown_connections 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb270077f70 0x7fb27007a430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2901529d0 0x7fb290149a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2901fd0e0 0x7fb2900cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 --2- 172.21.15.81:0/1460571177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb290070c10 0x7fb290200ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.177+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 >> 172.21.15.81:0/1460571177 conn(0x7fb2900700f0 msgr2=0x7fb29015b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.178+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 shutdown_connections 2024-09-11T01:09:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.178+0000 7fb297a00640 1 -- 172.21.15.81:0/1460571177 wait complete. 2024-09-11T01:09:07.222 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:09:07.222 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 -- 172.21.15.81:0/2847057549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00d4530 msgr2=0x7f89c004bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2847057549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00d4530 0x7f89c004bd20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005fd0 tx=0x7f89b402b7f0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 -- 172.21.15.81:0/2847057549 shutdown_connections 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2847057549 >> v2:172.21.15.81:3300/0 conn(0x7f89c000dc20 0x7f89c00e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2847057549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00d4530 0x7f89c004bd20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.645+0000 7f89c7e00640 1 -- 172.21.15.81:0/2847057549 >> 172.21.15.81:0/2847057549 conn(0x7f89c004fc00 msgr2=0x7f89c0050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:07.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.646+0000 7f89c7e00640 1 -- 172.21.15.81:0/2847057549 shutdown_connections 2024-09-11T01:09:07.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.646+0000 7f89c7e00640 1 -- 172.21.15.81:0/2847057549 wait complete. 2024-09-11T01:09:07.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.651+0000 7f89c7e00640 1 Processor -- start 2024-09-11T01:09:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.652+0000 7f89c7e00640 1 -- start start 2024-09-11T01:09:07.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c00d4530 0x7f89c0164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89c00d4910 con 0x7f89c000dc20 2024-09-11T01:09:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89c00457e0 con 0x7f89c00d4530 2024-09-11T01:09:07.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.655+0000 7f89c7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89c0050800 con 0x7f89c00da540 2024-09-11T01:09:07.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.660+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.662+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58356/0 (socket says 172.21.15.81:58356) 2024-09-11T01:09:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.662+0000 7f89c7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.662+0000 7f89c7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:48176/0 (socket says 172.21.15.81:48176) 2024-09-11T01:09:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.662+0000 7f89c7400640 1 -- 172.21.15.81:0/2332842993 learned_addr learned my addr 172.21.15.81:0/2332842993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:07.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.662+0000 7f89c6000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c00d4530 0x7f89c0164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.663+0000 7f89c7400640 1 -- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c00d4530 msgr2=0x7f89c0164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.663+0000 7f89c7400640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c00d4530 0x7f89c0164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.663+0000 7f89c7400640 1 -- 172.21.15.81:0/2332842993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 msgr2=0x7f89c0162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.665+0000 7f89c7400640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.665+0000 7f89c7400640 1 -- 172.21.15.81:0/2332842993 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c00d7b10 con 0x7f89c00da540 2024-09-11T01:09:07.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.665+0000 7f89c6a00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:09:07.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.666+0000 7f89c7400640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f89c806bcb0 tx=0x7f89c806ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.667+0000 7f89bf400640 1 -- 172.21.15.81:0/2332842993 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c806a440 con 0x7f89c00da540 2024-09-11T01:09:07.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.667+0000 7f89bf400640 1 -- 172.21.15.81:0/2332842993 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89c8095440 con 0x7f89c00da540 2024-09-11T01:09:07.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.667+0000 7f89bf400640 1 -- 172.21.15.81:0/2332842993 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8095870 con 0x7f89c00da540 2024-09-11T01:09:07.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.669+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c0161d90 con 0x7f89c00da540 2024-09-11T01:09:07.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.669+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c01609a0 con 0x7f89c00da540 2024-09-11T01:09:07.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.675+0000 7f89d0c5e740 1 Processor -- start 2024-09-11T01:09:07.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.680+0000 7f89bf400640 1 -- 172.21.15.81:0/2332842993 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f89c8093070 con 0x7f89c00da540 2024-09-11T01:09:07.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.682+0000 7f89bf400640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 0x7f89a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.685+0000 7f89bf400640 1 -- 172.21.15.81:0/2332842993 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f89c8114990 con 0x7f89c00da540 2024-09-11T01:09:07.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.685+0000 7f89d0c5e740 1 -- start start 2024-09-11T01:09:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89c6000640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 0x7f89a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55aa7c0 0x5606a55aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606a5523260 con 0x5606a55eeba0 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5606a5512690 con 0x5606a55aa7c0 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.686+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5606a55164a0 con 0x5606a55b10c0 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.687+0000 7f89c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.687+0000 7f89c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58362/0 (socket says 172.21.15.81:58362) 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.687+0000 7f89c7400640 1 -- 172.21.15.81:0/174276980 learned_addr learned my addr 172.21.15.81:0/174276980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.688+0000 7f89c7400640 1 -- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 msgr2=0x5606a55b1800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:09:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.688+0000 7f89c7400640 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55b1800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.688+0000 7f89c7400640 1 -- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55aa7c0 msgr2=0x5606a55aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.689+0000 7f89c6a00640 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55aa7c0 0x5606a55aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.689+0000 7f89c7400640 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55aa7c0 0x5606a55aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.689+0000 7f89c7400640 1 -- 172.21.15.81:0/174276980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a52ecd80 con 0x5606a55eeba0 2024-09-11T01:09:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.690+0000 7f89c7400640 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f89c806b7b0 tx=0x7f89c80e4350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755a050efca1397 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.692+0000 7f89b3400640 1 -- 172.21.15.81:0/174276980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c80daf40 con 0x5606a55eeba0 2024-09-11T01:09:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.692+0000 7f89b3400640 1 -- 172.21.15.81:0/174276980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89c8073e80 con 0x5606a55eeba0 2024-09-11T01:09:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.692+0000 7f89b3400640 1 -- 172.21.15.81:0/174276980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c80db0e0 con 0x5606a55eeba0 2024-09-11T01:09:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.693+0000 7f89c6000640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 0x7f89a807a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5606a55acb50 tx=0x7f89b8009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.694+0000 7f89d0c5e740 1 -- 172.21.15.81:0/174276980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 msgr2=0x5606a55e5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.694+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f89c806b7b0 tx=0x7f89c80e4350 comp rx=0 tx=0).stop 2024-09-11T01:09:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.696+0000 7f89d0c5e740 1 -- 172.21.15.81:0/174276980 shutdown_connections 2024-09-11T01:09:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.696+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55e5d10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.696+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.697+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/174276980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55aa7c0 0x5606a55aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.697+0000 7f89d0c5e740 1 -- 172.21.15.81:0/174276980 >> 172.21.15.81:0/174276980 conn(0x5606a55ac520 msgr2=0x5606a55afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:07.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.698+0000 7f89d0c5e740 1 -- 172.21.15.81:0/174276980 shutdown_connections 2024-09-11T01:09:07.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.698+0000 7f89d0c5e740 1 -- 172.21.15.81:0/174276980 wait complete. 2024-09-11T01:09:07.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.700+0000 7f89d0c5e740 1 -- start start 2024-09-11T01:09:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.702+0000 7f89d0c5e740 1 Processor -- start 2024-09-11T01:09:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55e30a0 0x5606a55d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606a5282cc0 con 0x5606a55eeba0 2024-09-11T01:09:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5606a54b7e60 con 0x5606a55e30a0 2024-09-11T01:09:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5606a55b0500 con 0x5606a55b10c0 2024-09-11T01:09:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.705+0000 7f89d0c5e740 10 client.0 _ll_register_callbacks cb 0x5606a54be030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.706+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.707+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:48178/0 (socket says 172.21.15.81:48178) 2024-09-11T01:09:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.707+0000 7f89c6a00640 1 -- 172.21.15.81:0/1865029510 learned_addr learned my addr 172.21.15.81:0/1865029510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.707+0000 7f89c7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55e30a0 0x5606a55d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.708+0000 7f89c6000640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.708+0000 7f89c6a00640 1 -- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55e30a0 msgr2=0x5606a55d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.708+0000 7f89c6a00640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55e30a0 0x5606a55d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.708+0000 7f89c6a00640 1 -- 172.21.15.81:0/1865029510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 msgr2=0x5606a55d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.709+0000 7f89c6a00640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55d72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.709+0000 7f89c6a00640 1 -- 172.21.15.81:0/1865029510 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5606a534d510 con 0x5606a55b10c0 2024-09-11T01:09:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.709+0000 7f89c6000640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:09:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.710+0000 7f89a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T01:09:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.710+0000 7f89c6a00640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89b402bde0 tx=0x7f89b4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64268432a8c9bd12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.711+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4044020 con 0x5606a55b10c0 2024-09-11T01:09:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.711+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f89b4003800 con 0x5606a55b10c0 2024-09-11T01:09:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.712+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89c8073e80 con 0x5606a55b10c0 2024-09-11T01:09:07.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.713+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f89b4044020 con 0x5606a55b10c0 2024-09-11T01:09:07.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.713+0000 7f89d0c5e740 10 client.5465 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.713+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5606a5251c20 con 0x5606a55b10c0 2024-09-11T01:09:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.715+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89b4003a00 con 0x5606a55b10c0 2024-09-11T01:09:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f89b4003bb0 con 0x5606a55b10c0 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 10 client.5465 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 10 client.5465 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 20 client.5465 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a55e4c40 0x5606a55e5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 4 client.5465 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.717+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f89c8073e80 con 0x5606a55e4c40 2024-09-11T01:09:07.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.720+0000 7f89c6000640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a55e4c40 0x5606a55e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.733+0000 7f89c6000640 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a55e4c40 0x5606a55e5020 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=383a7078a8732af4 server_cookie=e38a600a15289c6d in_seq=0 out_seq=0 2024-09-11T01:09:07.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.733+0000 7f89a7e00640 10 client.5465 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.734+0000 7f89a7e00640 1 -- 172.21.15.81:0/1865029510 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f89c8073e80 con 0x5606a55e4c40 2024-09-11T01:09:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.734+0000 7f89a7e00640 10 client.5465 handle_command_reply: tid=0 2024-09-11T01:09:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.735+0000 7f89d0c5e740 1 client.5465 shutdown 2024-09-11T01:09:07.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.736+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 msgr2=0x5606a55df460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.736+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89b402bde0 tx=0x7f89b4004270 comp rx=0 tx=0).stop 2024-09-11T01:09:07.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 shutdown_connections 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a55e4c40 0x5606a55e5020 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55e30a0 0x5606a55d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55eeba0 0x5606a55d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/1865029510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a55df460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 >> 172.21.15.81:0/1865029510 conn(0x5606a55aa7c0 msgr2=0x5606a55de840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:07.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.737+0000 7f89a7e00640 0 client.5465 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:07.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.738+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 shutdown_connections 2024-09-11T01:09:07.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.740+0000 7f89d0c5e740 1 -- 172.21.15.81:0/1865029510 wait complete. 2024-09-11T01:09:07.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.740+0000 7f89d0c5e740 20 client.5465 trim_cache size 0 max 16384 2024-09-11T01:09:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.791+0000 7f89d0c5e740 1 Processor -- start 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.792+0000 7f89d0c5e740 1 -- start start 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.792+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.792+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a55e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55eeba0 0x5606a55e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01879b0 con 0x5606a55e30a0 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89c0186890 con 0x5606a55b10c0 2024-09-11T01:09:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89c0174870 con 0x5606a55eeba0 2024-09-11T01:09:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:52678/0 (socket says 172.21.15.81:52678) 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.794+0000 7f89c7400640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55eeba0 0x5606a55e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.793+0000 7f89c6a00640 1 -- 172.21.15.81:0/3258930334 learned_addr learned my addr 172.21.15.81:0/3258930334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.794+0000 7f89c6a00640 1 -- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55eeba0 msgr2=0x5606a55e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.794+0000 7f89c6a00640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55eeba0 0x5606a55e4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.794+0000 7f89c6a00640 1 -- 172.21.15.81:0/3258930334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 msgr2=0x5606a55e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.794+0000 7f89c6000640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a55e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.795+0000 7f89c6a00640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a55e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.795+0000 7f89c6a00640 1 -- 172.21.15.81:0/3258930334 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a5602440 con 0x5606a55b10c0 2024-09-11T01:09:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.795+0000 7f89c6000640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a55e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:09:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.795+0000 7f89c6a00640 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005ab0 tx=0x7f89b4005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c36bb8ec9cdd9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.796+0000 7f89b2a00640 1 -- 172.21.15.81:0/3258930334 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400d000 con 0x5606a55b10c0 2024-09-11T01:09:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.796+0000 7f89b2a00640 1 -- 172.21.15.81:0/3258930334 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89b4003800 con 0x5606a55b10c0 2024-09-11T01:09:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.796+0000 7f89b2a00640 1 -- 172.21.15.81:0/3258930334 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4003c50 con 0x5606a55b10c0 2024-09-11T01:09:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.798+0000 7f89d0c5e740 1 -- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 msgr2=0x5606a55e27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005ab0 tx=0x7f89b4005b50 comp rx=0 tx=0).stop 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 -- 172.21.15.81:0/3258930334 shutdown_connections 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55eeba0 0x5606a55e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a55e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/3258930334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55b10c0 0x5606a55e27e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 -- 172.21.15.81:0/3258930334 >> 172.21.15.81:0/3258930334 conn(0x5606a55aa7c0 msgr2=0x5606a55dac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 -- 172.21.15.81:0/3258930334 shutdown_connections 2024-09-11T01:09:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.799+0000 7f89d0c5e740 1 -- 172.21.15.81:0/3258930334 wait complete. 2024-09-11T01:09:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.801+0000 7f89d0c5e740 1 -- start start 2024-09-11T01:09:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.801+0000 7f89d0c5e740 1 Processor -- start 2024-09-11T01:09:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a560a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 0x5606a56727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01854a0 con 0x5606a55e30a0 2024-09-11T01:09:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01861c0 con 0x5606a55eeba0 2024-09-11T01:09:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89c0185b30 con 0x5606a55b10c0 2024-09-11T01:09:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.803+0000 7f89d0c5e740 10 client.0 _ll_register_callbacks cb 0x7f89b4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.805+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.806+0000 7f89c7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 0x5606a56727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.806+0000 7f89c7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 0x5606a56727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:52694/0 (socket says 172.21.15.81:52694) 2024-09-11T01:09:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.806+0000 7f89c7400640 1 -- 172.21.15.81:0/976595548 learned_addr learned my addr 172.21.15.81:0/976595548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.806+0000 7f89c6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a560a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.806+0000 7f89c6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:48200/0 (socket says 172.21.15.81:48200) 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.807+0000 7f89c6a00640 1 -- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 msgr2=0x5606a56727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.807+0000 7f89c6a00640 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 0x5606a56727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.807+0000 7f89c6a00640 1 -- 172.21.15.81:0/976595548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 msgr2=0x5606a560a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.807+0000 7f89c6a00640 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a560a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.807+0000 7f89c6a00640 1 -- 172.21.15.81:0/976595548 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5606a55e8e10 con 0x5606a55b10c0 2024-09-11T01:09:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.808+0000 7f89c6a00640 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89b403f000 tx=0x7f89b402bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6e3aba9fee1da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.808+0000 7f89a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-09-11T01:09:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.810+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400d000 con 0x5606a55b10c0 2024-09-11T01:09:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.810+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f89b404ae10 con 0x5606a55b10c0 2024-09-11T01:09:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.811+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b4003800 con 0x5606a55b10c0 2024-09-11T01:09:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.814+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f89b4034480 con 0x5606a55b10c0 2024-09-11T01:09:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.814+0000 7f89d0c5e740 10 client.5471 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.814+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5606a55e1ee0 con 0x5606a55b10c0 2024-09-11T01:09:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.815+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89b4003800 con 0x5606a55b10c0 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.815+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f89b4005480 con 0x5606a55b10c0 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 10 client.5471 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 10 client.5471 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 20 client.5471 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a560ae20 0x5606a5672d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 4 client.5471 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:09:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5606a55251b0 con 0x5606a560ae20 2024-09-11T01:09:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.817+0000 7f89c6000640 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a560ae20 0x5606a5672d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.818+0000 7f89c6000640 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a560ae20 0x5606a5672d10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89b8ebdf7054779 server_cookie=ffd8a241cfaa85a6 in_seq=0 out_seq=0 2024-09-11T01:09:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:07.819+0000 7f89a7e00640 10 client.5471 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89a7e00640 1 -- 172.21.15.81:0/976595548 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5606a55251b0 con 0x5606a560ae20 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89a7e00640 10 client.5471 handle_command_reply: tid=0 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89d0c5e740 1 client.5471 shutdown 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 msgr2=0x5606a5675fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89b403f000 tx=0x7f89b402bd10 comp rx=0 tx=0).stop 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.051+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 shutdown_connections 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x5606a560ae20 0x5606a5672d10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606a55eeba0 0x5606a56727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606a55e30a0 0x5606a560a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 --2- 172.21.15.81:0/976595548 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606a55b10c0 0x5606a5675fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 >> 172.21.15.81:0/976595548 conn(0x5606a55aa7c0 msgr2=0x5606a55e48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89a7e00640 0 client.5471 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 shutdown_connections 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.052+0000 7f89d0c5e740 1 -- 172.21.15.81:0/976595548 wait complete. 2024-09-11T01:09:08.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.053+0000 7f89d0c5e740 20 client.5471 trim_cache size 0 max 16384 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 82, 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "70d28171": { 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 82, 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:08.059 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.054+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 msgr2=0x7f89a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.054+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 0x7f89a807a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5606a55acb50 tx=0x7f89b8009040 comp rx=0 tx=0).stop 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.054+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 msgr2=0x7f89c00cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.054+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f89c806bcb0 tx=0x7f89c806ae50 comp rx=0 tx=0).stop 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 shutdown_connections 2024-09-11T01:09:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f89a8077f70 0x7f89a807a430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89c00da540 0x7f89c00cc540 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c00d4530 0x7f89c0164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 --2- 172.21.15.81:0/2332842993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c000dc20 0x7f89c0162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 >> 172.21.15.81:0/2332842993 conn(0x7f89c004fc00 msgr2=0x7f89c00d8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 shutdown_connections 2024-09-11T01:09:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:08.055+0000 7f89c7e00640 1 -- 172.21.15.81:0/2332842993 wait complete. 2024-09-11T01:09:08.073 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '70d28171', quiesce took 1.8 seconds. Will release after: 28.2 2024-09-11T01:09:33.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:33.057 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:09:36.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 -- 172.21.15.81:0/2749485142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e8074860 msgr2=0x7fa6e80c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 --2- 172.21.15.81:0/2749485142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e8074860 0x7fa6e80c7980 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8074fb0 tx=0x7fa6d402a5a0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 -- 172.21.15.81:0/2749485142 shutdown_connections 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 --2- 172.21.15.81:0/2749485142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e80c8680 0x7fa6e80c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 --2- 172.21.15.81:0/2749485142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e8074860 0x7fa6e80c7980 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 -- 172.21.15.81:0/2749485142 >> 172.21.15.81:0/2749485142 conn(0x7fa6e80700f0 msgr2=0x7fa6e8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 -- 172.21.15.81:0/2749485142 shutdown_connections 2024-09-11T01:09:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.440+0000 7fa6ee000640 1 -- 172.21.15.81:0/2749485142 wait complete. 2024-09-11T01:09:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.442+0000 7fa6ee000640 1 Processor -- start 2024-09-11T01:09:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.442+0000 7fa6ee000640 1 -- start start 2024-09-11T01:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 0x7fa6e80c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e8152610 0x7fa6e81539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8070cf0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815c140 con 0x7fa6e8074860 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6ee000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e80c16a0 con 0x7fa6e8152610 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49714/0 (socket says 172.21.15.81:49714) 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 -- 172.21.15.81:0/75835088 learned_addr learned my addr 172.21.15.81:0/75835088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7400640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 0x7fa6e80c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e6a00640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e8152610 0x7fa6e81539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 -- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e8152610 msgr2=0x7fa6e81539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e8152610 0x7fa6e81539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 -- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 msgr2=0x7fa6e80c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 0x7fa6e80c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7e00640 1 -- 172.21.15.81:0/75835088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e81f2380 con 0x7fa6e80c30e0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.443+0000 7fa6e7400640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 0x7fa6e80c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6e7e00640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e940 tx=0x7fa6e000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000ccc0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6e0005020 con 0x7fa6e80c30e0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000ce60 con 0x7fa6e80c30e0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e81f2600 con 0x7fa6e80c30e0 2024-09-11T01:09:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.444+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81531f0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.445+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e81529f0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.446+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa6e0005450 con 0x7fa6e80c30e0 2024-09-11T01:09:36.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.447+0000 7fa6df400640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 0x7fa6c807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.447+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa6e009aaf0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.448+0000 7fa6e7400640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 0x7fa6c807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.448+0000 7fa6e7400640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 0x7fa6c807a460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8002210 tx=0x7fa6d8009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.452+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa6e81f2380 con 0x7fa6e80c30e0 2024-09-11T01:09:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.670+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6e80c1db0 con 0x7fa6e80c30e0 2024-09-11T01:09:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.670+0000 7fa6df400640 1 -- 172.21.15.81:0/75835088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fa6e0063270 con 0x7fa6e80c30e0 2024-09-11T01:09:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:09:36.673 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:09:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:09:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 msgr2=0x7fa6c807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 0x7fa6c807a460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8002210 tx=0x7fa6d8009040 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 msgr2=0x7fa6e80c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e940 tx=0x7fa6e000ee00 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 shutdown_connections 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa6c8077fa0 0x7fa6c807a460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6e80c30e0 0x7fa6e80c5350 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6e8152610 0x7fa6e81539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 --2- 172.21.15.81:0/75835088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6e8074860 0x7fa6e80c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 >> 172.21.15.81:0/75835088 conn(0x7fa6e80700f0 msgr2=0x7fa6e81509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 shutdown_connections 2024-09-11T01:09:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.673+0000 7fa6ee000640 1 -- 172.21.15.81:0/75835088 wait complete. 2024-09-11T01:09:36.691 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 70d28171 --release --await' 2024-09-11T01:09:36.691 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 70d28171 --release --await 2024-09-11T01:09:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 -- 172.21.15.81:0/3647403402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2580c94b0 msgr2=0x7ff2580725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 --2- 172.21.15.81:0/3647403402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2580c94b0 0x7ff2580725e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff2580b2200 tx=0x7ff25002a940 comp rx=0 tx=0).stop 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 -- 172.21.15.81:0/3647403402 shutdown_connections 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 --2- 172.21.15.81:0/3647403402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2580c94b0 0x7ff2580725e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 --2- 172.21.15.81:0/3647403402 >> v2:172.21.15.167:3300/0 conn(0x7ff258152550 0x7ff258074dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 -- 172.21.15.81:0/3647403402 >> 172.21.15.81:0/3647403402 conn(0x7ff2580c8990 msgr2=0x7ff2580c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 -- 172.21.15.81:0/3647403402 shutdown_connections 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.854+0000 7ff25e800640 1 -- 172.21.15.81:0/3647403402 wait complete. 2024-09-11T01:09:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.855+0000 7ff25e800640 1 Processor -- start 2024-09-11T01:09:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.855+0000 7ff25e800640 1 -- start start 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2580c94b0 0x7ff2581e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff258152550 0x7ff2581dee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2580c73c0 con 0x7ff2581e23f0 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff258158df0 con 0x7ff258152550 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.856+0000 7ff25e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff2580c8280 con 0x7ff2580c94b0 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49726/0 (socket says 172.21.15.81:49726) 2024-09-11T01:09:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 -- 172.21.15.81:0/3074792338 learned_addr learned my addr 172.21.15.81:0/3074792338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25ca00640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff258152550 0x7ff2581dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25d400640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2580c94b0 0x7ff2581e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 -- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2580c94b0 msgr2=0x7ff2581e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2580c94b0 0x7ff2581e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 -- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff258152550 msgr2=0x7ff2581dee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff258152550 0x7ff2581dee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 -- 172.21.15.81:0/3074792338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2581f0800 con 0x7ff2581e23f0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.857+0000 7ff25de00640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff250031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.858+0000 7ff255600640 1 -- 172.21.15.81:0/3074792338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250004240 con 0x7ff2581e23f0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.858+0000 7ff255600640 1 -- 172.21.15.81:0/3074792338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2500044f0 con 0x7ff2581e23f0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.858+0000 7ff255600640 1 -- 172.21.15.81:0/3074792338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25003a440 con 0x7ff2581e23f0 2024-09-11T01:09:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.858+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2581e1b70 con 0x7ff2581e23f0 2024-09-11T01:09:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.858+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581f0a70 con 0x7ff2581e23f0 2024-09-11T01:09:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.860+0000 7ff255600640 1 -- 172.21.15.81:0/3074792338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff25002f070 con 0x7ff2581e23f0 2024-09-11T01:09:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.861+0000 7ff255600640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 0x7ff23807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.861+0000 7ff255600640 1 -- 172.21.15.81:0/3074792338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff2500bb480 con 0x7ff2581e23f0 2024-09-11T01:09:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.861+0000 7ff25d400640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 0x7ff23807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.862+0000 7ff262e26740 1 Processor -- start 2024-09-11T01:09:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.862+0000 7ff262e26740 1 -- start start 2024-09-11T01:09:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.862+0000 7ff25d400640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 0x7ff23807a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bbe0 tx=0x7ff24c00b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15f885a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f4db20 0x557b15f88ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b15ec5370 con 0x557b15f50d90 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b15eb47a0 con 0x557b15f92a20 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557b15eb85b0 con 0x557b15f4db20 2024-09-11T01:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49740/0 (socket says 172.21.15.81:49740) 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 -- 172.21.15.81:0/2009848041 learned_addr learned my addr 172.21.15.81:0/2009848041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25de00640 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f4db20 0x557b15f88ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25ca00640 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15f885a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 -- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f4db20 msgr2=0x557b15f88ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f4db20 0x557b15f88ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 -- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 msgr2=0x557b15f885a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15f885a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.863+0000 7ff25d400640 1 -- 172.21.15.81:0/2009848041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b15e4d010 con 0x557b15f50d90 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.864+0000 7ff25d400640 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff24c005d00 tx=0x7ff24c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220b404a1927199c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.864+0000 7ff249c00640 1 -- 172.21.15.81:0/2009848041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c005220 con 0x557b15f50d90 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.864+0000 7ff249c00640 1 -- 172.21.15.81:0/2009848041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff24c0053c0 con 0x557b15f50d90 2024-09-11T01:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.864+0000 7ff249c00640 1 -- 172.21.15.81:0/2009848041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0047a0 con 0x557b15f50d90 2024-09-11T01:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.864+0000 7ff262e26740 1 -- 172.21.15.81:0/2009848041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 msgr2=0x557b15f9be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff24c005d00 tx=0x7ff24c013000 comp rx=0 tx=0).stop 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 -- 172.21.15.81:0/2009848041 shutdown_connections 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f4db20 0x557b15f88ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15f885a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 --2- 172.21.15.81:0/2009848041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f50d90 0x557b15f9be30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 -- 172.21.15.81:0/2009848041 >> 172.21.15.81:0/2009848041 conn(0x557b15f4ef70 msgr2=0x557b15f50450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 -- 172.21.15.81:0/2009848041 shutdown_connections 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 -- 172.21.15.81:0/2009848041 wait complete. 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.865+0000 7ff262e26740 1 -- start start 2024-09-11T01:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.866+0000 7ff262e26740 1 Processor -- start 2024-09-11T01:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 0x557b15f97240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15fa66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b15e5bf70 con 0x557b15f8ef90 2024-09-11T01:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b15e5a090 con 0x557b15f92a20 2024-09-11T01:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557b15fa70d0 con 0x557b15f50d90 2024-09-11T01:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff262e26740 10 client.0 _ll_register_callbacks cb 0x557b15bc3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49756/0 (socket says 172.21.15.81:49756) 2024-09-11T01:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 -- 172.21.15.81:0/582403599 learned_addr learned my addr 172.21.15.81:0/582403599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25d400640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 0x557b15f97240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25ca00640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15fa66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 -- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 msgr2=0x557b15f97240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 0x557b15f97240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 -- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 msgr2=0x557b15fa66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15fa66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25de00640 1 -- 172.21.15.81:0/582403599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b15c16ea0 con 0x557b15f8ef90 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25d400640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 0x557b15f97240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.867+0000 7ff25ca00640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15fa66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.868+0000 7ff25de00640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff250080700 tx=0x7ff250083390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3533d6feebd910 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.868+0000 7ff23e000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.870+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250049040 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.870+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff24c0053c0 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.870+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff2500826f0 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff25008c2b0 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 10 client.5895 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557b15c8fd30 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff24c0053c0 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff25007ede0 con 0x557b15f8ef90 2024-09-11T01:09:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 10 client.5895 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 10 client.5895 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 20 client.5895 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f87a10 0x557b15f910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 4 client.5895 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b15ec72c0 con 0x557b15f87a10 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.871+0000 7ff25d400640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f87a10 0x557b15f910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.872+0000 7ff25d400640 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f87a10 0x557b15f910a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a122dd956b7e9c4 server_cookie=fe17b37f93b839c6 in_seq=0 out_seq=0 2024-09-11T01:09:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.872+0000 7ff23e000640 10 client.5895 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.873+0000 7ff23e000640 1 -- 172.21.15.81:0/582403599 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b15ec72c0 con 0x557b15f87a10 2024-09-11T01:09:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.873+0000 7ff23e000640 10 client.5895 handle_command_reply: tid=0 2024-09-11T01:09:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.873+0000 7ff262e26740 1 client.5895 shutdown 2024-09-11T01:09:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.873+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 msgr2=0x557b15f95db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff250080700 tx=0x7ff250083390 comp rx=0 tx=0).stop 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 shutdown_connections 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f87a10 0x557b15f910a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f8ef90 0x557b15f95db0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f92a20 0x557b15fa66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 --2- 172.21.15.81:0/582403599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15f50d90 0x557b15f97240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff23e000640 0 client.5895 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 >> 172.21.15.81:0/582403599 conn(0x557b15f4db20 msgr2=0x557b15f52f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 shutdown_connections 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 1 -- 172.21.15.81:0/582403599 wait complete. 2024-09-11T01:09:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.874+0000 7ff262e26740 20 client.5895 trim_cache size 0 max 16384 2024-09-11T01:09:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.891+0000 7ff262e26740 1 Processor -- start 2024-09-11T01:09:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 -- start start 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b15f960f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f4fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ff2d0 con 0x557b15f92a20 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fe1b0 con 0x557b15f50d90 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.892+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff2581f3ff0 con 0x557b15fa3140 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49758/0 (socket says 172.21.15.81:49758) 2024-09-11T01:09:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 -- 172.21.15.81:0/626883392 learned_addr learned my addr 172.21.15.81:0/626883392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25d400640 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b15f960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 -- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 msgr2=0x557b15f4fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f4fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 -- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 msgr2=0x557b15f960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b15f960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 -- 172.21.15.81:0/626883392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b15f87df0 con 0x557b15f92a20 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25d400640 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b15f960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.893+0000 7ff25ca00640 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff244001800 tx=0x7ff244007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da123bce5e06874 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff249200640 1 -- 172.21.15.81:0/626883392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24401a070 con 0x557b15f92a20 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff249200640 1 -- 172.21.15.81:0/626883392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff244013c10 con 0x557b15f92a20 2024-09-11T01:09:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff249200640 1 -- 172.21.15.81:0/626883392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244005030 con 0x557b15f92a20 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 -- 172.21.15.81:0/626883392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 msgr2=0x557b15fa2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff244001800 tx=0x7ff244007e90 comp rx=0 tx=0).stop 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 -- 172.21.15.81:0/626883392 shutdown_connections 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f4fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b15fa2c00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 --2- 172.21.15.81:0/626883392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b15f960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 -- 172.21.15.81:0/626883392 >> 172.21.15.81:0/626883392 conn(0x557b15f4db20 msgr2=0x557b15f93230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 -- 172.21.15.81:0/626883392 shutdown_connections 2024-09-11T01:09:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.894+0000 7ff262e26740 1 -- 172.21.15.81:0/626883392 wait complete. 2024-09-11T01:09:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.895+0000 7ff262e26740 1 -- start start 2024-09-11T01:09:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.895+0000 7ff262e26740 1 Processor -- start 2024-09-11T01:09:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b16014c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f8a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fcdf0 con 0x557b15f92a20 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fdae0 con 0x557b15f50d90 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff2581fd410 con 0x557b15fa3140 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff262e26740 10 client.0 _ll_register_callbacks cb 0x7ff24c00b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff25ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff25ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49762/0 (socket says 172.21.15.81:49762) 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff25ca00640 1 -- 172.21.15.81:0/121967382 learned_addr learned my addr 172.21.15.81:0/121967382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff25d400640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b16014c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.896+0000 7ff25de00640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f8a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 -- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 msgr2=0x557b15f8a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f8a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 -- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 msgr2=0x557b16014c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b16014c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 -- 172.21.15.81:0/121967382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b15f97050 con 0x557b15f92a20 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff25ca00640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff2440017d0 tx=0x7ff244007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dbb0d2b4ff8790 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff23e000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244027070 con 0x557b15f92a20 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff244006a90 con 0x557b15f92a20 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff244013c10 con 0x557b15f92a20 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.897+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff244032050 con 0x557b15f92a20 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 10 client.5901 fetch_fsmap learned FSMap version 9 2024-09-11T01:09:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557b15f4f360 con 0x557b15f92a20 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff244013c10 con 0x557b15f92a20 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff244035020 con 0x557b15f92a20 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 10 client.5901 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 10 client.5901 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 20 client.5901 populate_metadata read hostname 'smithi081' 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f4d2e0 0x557b15f8a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 4 client.5901 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "70d28171", "release": true, "await": true}] 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "70d28171", "release": true, "await": true}) -- 0x557b15ec2d70 con 0x557b15f4d2e0 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.898+0000 7ff25d400640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f4d2e0 0x557b15f8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.899+0000 7ff25d400640 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f4d2e0 0x557b15f8a920 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535b05a72c35735f server_cookie=b321c1cb0defaa9d in_seq=0 out_seq=0 2024-09-11T01:09:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.899+0000 7ff23e000640 10 client.5901 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.922+0000 7ff23e000640 1 -- 172.21.15.81:0/121967382 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557b15ec2d70 con 0x557b15f4d2e0 2024-09-11T01:09:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.922+0000 7ff23e000640 10 client.5901 handle_command_reply: tid=0 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.922+0000 7ff262e26740 1 client.5901 shutdown 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.922+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 msgr2=0x557b1600b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.922+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff2440017d0 tx=0x7ff244007c30 comp rx=0 tx=0).stop 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 shutdown_connections 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557b15f4d2e0 0x557b15f8a920 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557b15fa3140 0x557b15f8a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b15f92a20 0x557b1600b110 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff23e000640 0 client.5901 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 --2- 172.21.15.81:0/121967382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b15f50d90 0x557b16014c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 >> 172.21.15.81:0/121967382 conn(0x557b15f4db20 msgr2=0x557b15f9fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 shutdown_connections 2024-09-11T01:09:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 1 -- 172.21.15.81:0/121967382 wait complete. 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.923+0000 7ff262e26740 20 client.5901 trim_cache size 0 max 16384 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 84, 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "70d28171": { 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 84, 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:09:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 150.0, 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:09:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:09:36.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 msgr2=0x7ff23807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 0x7ff23807a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bbe0 tx=0x7ff24c00b390 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 msgr2=0x7ff25814f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff250031ea0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 shutdown_connections 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff238077f70 0x7ff23807a430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2581e23f0 0x7ff25814f530 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff258152550 0x7ff2581dee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 --2- 172.21.15.81:0/3074792338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2580c94b0 0x7ff2581e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.924+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 >> 172.21.15.81:0/3074792338 conn(0x7ff2580c8990 msgr2=0x7ff2581516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.925+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 shutdown_connections 2024-09-11T01:09:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:09:36.925+0000 7ff25e800640 1 -- 172.21.15.81:0/3074792338 wait complete. 2024-09-11T01:09:36.948 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '70d28171', total seconds elapsed: 30.7 2024-09-11T01:10:03.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:10:03.160 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:10:33.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:10:33.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:11:08.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:11:09.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:11:28.377 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:11:28.377 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.45 2024-09-11T01:11:28.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:11:41.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:11:41.741 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:11:43.308 INFO:tasks.workunit.client.0.smithi081.stdout:Syncing()...17 sec 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:FFSB benchmark finished at: Wed Sep 11 01:11:43 2024 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:Results: 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:Benchmark took 325.95 sec 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:Total Results 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:=============== 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout: ======= ============ ========= ======= =========== ========== 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout: write : 611840 1877.07 100.000% 100.000% 7.33MB/sec 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:- 2024-09-11T01:11:43.309 INFO:tasks.workunit.client.0.smithi081.stdout:1877.07 Transactions per Second 2024-09-11T01:11:43.310 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.310 INFO:tasks.workunit.client.0.smithi081.stdout:Throughput Results 2024-09-11T01:11:43.310 INFO:tasks.workunit.client.0.smithi081.stdout:=================== 2024-09-11T01:11:43.310 INFO:tasks.workunit.client.0.smithi081.stdout:Write Throughput: 7.33MB/sec 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout:System Call Latency statistics in millisecs 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout:===== 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: Min Avg Max Total Calls 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: ======== ======== ======== ============ 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout:[ open] 1.133000 44.901690 164.664993 478 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:11:43.318 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 24 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 138 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 225 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 64 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 19 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 4 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-11T01:11:43.319 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout:[ write] 0.163000 15.980266 29005.984375 611840 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 5 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 8 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 31 2024-09-11T01:11:43.320 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 449 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 859 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 15414 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 93718 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 117578 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 103197 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 88971 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 57732 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 71167 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 61735 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 848 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-11T01:11:43.321 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout:[ lseek] 0.000000 0.001865 6.408000 611840 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T01:11:43.322 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 2 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 4 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 8 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 28 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 69 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 103 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 133 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 608 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 909 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 609976 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.323 INFO:tasks.workunit.client.0.smithi081.stdout:[ close] 0.034000 5.043278 81.186996 478 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 34 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 38 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 32 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 56 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 35 2024-09-11T01:11:43.324 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 59 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 97 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 45 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 72 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 5 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout:0.4% User Time 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout:22.2% System Time 2024-09-11T01:11:43.325 INFO:tasks.workunit.client.0.smithi081.stdout:22.6% CPU Utilization 2024-09-11T01:11:43.326 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .. 2024-09-11T01:11:43.332 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -r tmp ffsb 2024-09-11T01:11:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 -- 172.21.15.81:0/1806459655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c152610 msgr2=0x7f021c0c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 --2- 172.21.15.81:0/1806459655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c152610 0x7f021c0c0f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f021c15c630 tx=0x7f020c02a670 comp rx=0 tx=0).stop 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 -- 172.21.15.81:0/1806459655 shutdown_connections 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 --2- 172.21.15.81:0/1806459655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074860 0x7f021c0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 --2- 172.21.15.81:0/1806459655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c152610 0x7f021c0c0f90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 -- 172.21.15.81:0/1806459655 >> 172.21.15.81:0/1806459655 conn(0x7f021c0700f0 msgr2=0x7f021c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 -- 172.21.15.81:0/1806459655 shutdown_connections 2024-09-11T01:11:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.451+0000 7f0220c00640 1 -- 172.21.15.81:0/1806459655 wait complete. 2024-09-11T01:11:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.453+0000 7f0220c00640 1 Processor -- start 2024-09-11T01:11:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.453+0000 7f0220c00640 1 -- start start 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c152610 0x7f021c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074410 0x7f021c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f021c070cf0 con 0x7f021c074860 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f021c15c140 con 0x7f021c152610 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0220c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f021c1529f0 con 0x7f021c074410 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58184/0 (socket says 172.21.15.81:58184) 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 -- 172.21.15.81:0/2346234005 learned_addr learned my addr 172.21.15.81:0/2346234005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219400640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c152610 0x7f021c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f021a800640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074410 0x7f021c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 -- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074410 msgr2=0x7f021c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074410 0x7f021c153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 -- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c152610 msgr2=0x7f021c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c152610 0x7f021c1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.454+0000 7f0219e00640 1 -- 172.21.15.81:0/2346234005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c159700 con 0x7f021c074860 2024-09-11T01:11:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0219e00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f020c034040 tx=0x7f020c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c03e030 con 0x7f021c074860 2024-09-11T01:11:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f020c003e00 con 0x7f021c074860 2024-09-11T01:11:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c1599e0 con 0x7f021c074860 2024-09-11T01:11:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c035040 con 0x7f021c074860 2024-09-11T01:11:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.455+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c153210 con 0x7f021c074860 2024-09-11T01:11:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.456+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021c0c2ea0 con 0x7f021c074860 2024-09-11T01:11:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.457+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f020c0049c0 con 0x7f021c074860 2024-09-11T01:11:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.458+0000 7f0212000640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 0x7f01fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.458+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f020c0baa10 con 0x7f021c074860 2024-09-11T01:11:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.459+0000 7f0219400640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 0x7f01fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.459+0000 7f0219400640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 0x7f01fc07a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f021c14d760 tx=0x7f020800b390 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.463+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f020c082b40 con 0x7f021c074860 2024-09-11T01:11:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.694+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f021c0c2a70 con 0x7f021c074860 2024-09-11T01:11:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.694+0000 7f0212000640 1 -- 172.21.15.81:0/2346234005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f020c087570 con 0x7f021c074860 2024-09-11T01:11:43.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:11:43.696 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:11:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:11:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 msgr2=0x7f01fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 0x7f01fc07a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f021c14d760 tx=0x7f020800b390 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 msgr2=0x7f021c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f020c034040 tx=0x7f020c003910 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 shutdown_connections 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f01fc077f70 0x7f01fc07a430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f021c074410 0x7f021c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c152610 0x7f021c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 --2- 172.21.15.81:0/2346234005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c074860 0x7f021c154b40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 >> 172.21.15.81:0/2346234005 conn(0x7f021c0700f0 msgr2=0x7f021c06f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 shutdown_connections 2024-09-11T01:11:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.697+0000 7f0220c00640 1 -- 172.21.15.81:0/2346234005 wait complete. 2024-09-11T01:11:43.721 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 148.45 --await-for 45.0' 2024-09-11T01:11:43.722 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 148.45 --await-for 45.0 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 -- 172.21.15.81:0/222656568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 msgr2=0x7fadcc0cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 --2- 172.21.15.81:0/222656568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc0cadf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fadcc06eb70 tx=0x7fadc002a5f0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 -- 172.21.15.81:0/222656568 shutdown_connections 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 --2- 172.21.15.81:0/222656568 >> v2:172.21.15.167:3300/0 conn(0x7fadcc0c4f60 0x7fadcc0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 --2- 172.21.15.81:0/222656568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 0x7fadcc0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 --2- 172.21.15.81:0/222656568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc0cadf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 -- 172.21.15.81:0/222656568 >> 172.21.15.81:0/222656568 conn(0x7fadcc0688e0 msgr2=0x7fadcc068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 -- 172.21.15.81:0/222656568 shutdown_connections 2024-09-11T01:11:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.933+0000 7fadd2200640 1 -- 172.21.15.81:0/222656568 wait complete. 2024-09-11T01:11:43.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.934+0000 7fadd2200640 1 Processor -- start 2024-09-11T01:11:43.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.935+0000 7fadd2200640 1 -- start start 2024-09-11T01:11:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.935+0000 7fadd2200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.935+0000 7fadd2200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 0x7fadcc0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.935+0000 7fadd2200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc14aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd2200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc15b0b0 con 0x7fadcc154810 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd2200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc15add0 con 0x7fadcc0c4f60 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd2200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc15a500 con 0x7fadcc0cc030 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc14aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd0e00640 1 -- 172.21.15.81:0/481048828 learned_addr learned my addr 172.21.15.81:0/481048828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadcbe00640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 0x7fadcc0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 -- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 msgr2=0x7fadcc0c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 0x7fadcc0c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 -- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 msgr2=0x7fadcc1e7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd1800640 1 -- 172.21.15.81:0/481048828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc14eab0 con 0x7fadcc154810 2024-09-11T01:11:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.936+0000 7fadd0e00640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadd1800640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc14aac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fadc400e990 tx=0x7fadc400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadc8c00640 1 -- 172.21.15.81:0/481048828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4004d20 con 0x7fadcc154810 2024-09-11T01:11:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadc8c00640 1 -- 172.21.15.81:0/481048828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc400caa0 con 0x7fadcc154810 2024-09-11T01:11:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc150950 con 0x7fadcc154810 2024-09-11T01:11:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadc8c00640 1 -- 172.21.15.81:0/481048828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4005020 con 0x7fadcc154810 2024-09-11T01:11:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.937+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc14b7c0 con 0x7fadcc154810 2024-09-11T01:11:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.939+0000 7fadc8c00640 1 -- 172.21.15.81:0/481048828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fadc400f040 con 0x7fadcc154810 2024-09-11T01:11:43.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.940+0000 7fadc8c00640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 0x7fadac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.940+0000 7fadc8c00640 1 -- 172.21.15.81:0/481048828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fadc409a620 con 0x7fadcc154810 2024-09-11T01:11:43.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.940+0000 7fadd0e00640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 0x7fadac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.941+0000 7fadd0e00640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 0x7fadac07a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadc00096c0 tx=0x7fadc0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.963+0000 7fadd65e5740 1 Processor -- start 2024-09-11T01:11:43.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.963+0000 7fadd65e5740 1 -- start start 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a95680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a99d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e1a0d240 con 0x55c2e1a98360 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c2e19fc670 con 0x55c2e1a98d00 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.964+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55c2e1a00480 con 0x55c2e1a95bc0 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a95680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:47374/0 (socket says 172.21.15.81:47374) 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a99d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:48276/0 (socket says 172.21.15.81:48276) 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 -- 172.21.15.81:0/2878533757 learned_addr learned my addr 172.21.15.81:0/2878533757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 -- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 msgr2=0x55c2e1a99d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a99d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 -- 172.21.15.81:0/2878533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 msgr2=0x55c2e1a95680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a95680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 -- 172.21.15.81:0/2878533757 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e17d6de0 con 0x55c2e1a95bc0 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd0e00640 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a95680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.965+0000 7fadd1800640 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fadc4062650 tx=0x7fadc4061ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de704413bf5d44b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadbd600640 1 -- 172.21.15.81:0/2878533757 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc401f040 con 0x55c2e1a95bc0 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadbd600640 1 -- 172.21.15.81:0/2878533757 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc40670f0 con 0x55c2e1a95bc0 2024-09-11T01:11:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadbd600640 1 -- 172.21.15.81:0/2878533757 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc406bb10 con 0x55c2e1a95bc0 2024-09-11T01:11:43.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadd65e5740 1 -- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 msgr2=0x55c2e1a9a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadd65e5740 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fadc4062650 tx=0x7fadc4061ef0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.966+0000 7fadd65e5740 1 -- 172.21.15.81:0/2878533757 shutdown_connections 2024-09-11T01:11:43.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a95bc0 0x55c2e1a9a2b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a99d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 --2- 172.21.15.81:0/2878533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a95680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 -- 172.21.15.81:0/2878533757 >> 172.21.15.81:0/2878533757 conn(0x55c2e1a96500 msgr2=0x55c2e1a979e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 -- 172.21.15.81:0/2878533757 shutdown_connections 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 -- 172.21.15.81:0/2878533757 wait complete. 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 -- start start 2024-09-11T01:11:43.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.967+0000 7fadd65e5740 1 Processor -- start 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a98d00 0x55c2e1aca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1ade0d0 0x55c2e1aca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e176cd20 con 0x55c2e1a98360 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c2e19a1dd0 con 0x55c2e1ade0d0 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.968+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55c2e1a94fc0 con 0x55c2e1a98d00 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd65e5740 10 client.0 _ll_register_callbacks cb 0x55c2e170a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33122/0 (socket says 172.21.15.81:33122) 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 -- 172.21.15.81:0/1375352724 learned_addr learned my addr 172.21.15.81:0/1375352724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadcbe00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a98d00 0x55c2e1aca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd1800640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1ade0d0 0x55c2e1aca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 -- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a98d00 msgr2=0x55c2e1aca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a98d00 0x55c2e1aca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 -- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1ade0d0 msgr2=0x55c2e1aca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1ade0d0 0x55c2e1aca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 -- 172.21.15.81:0/1375352724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e1837570 con 0x55c2e1a98360 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003f20 tx=0x7fadc0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e1b13ddaf1b81c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.969+0000 7fadb2000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc004e030 con 0x55c2e1a98360 2024-09-11T01:11:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fadc003cd80 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc40670f0 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fadc005a050 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadd65e5740 10 client.5919 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c2e173bc80 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc40670f0 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.970+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fadc005d020 con 0x55c2e1a98360 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 10 client.5919 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 10 client.5919 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 20 client.5919 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1aeab10 0x55c2e1aeaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 4 client.5919 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e1a0f190 con 0x55c2e1aeab10 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.971+0000 7fadcbe00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1aeab10 0x55c2e1aeaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.972+0000 7fadcbe00640 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1aeab10 0x55c2e1aeaf10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814bbe93a26ce14e server_cookie=7827b9f80fa76d2e in_seq=0 out_seq=0 2024-09-11T01:11:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.972+0000 7fadb2000640 10 client.5919 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.972+0000 7fadb2000640 1 -- 172.21.15.81:0/1375352724 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2e1a0f190 con 0x55c2e1aeab10 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.972+0000 7fadb2000640 10 client.5919 handle_command_reply: tid=0 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.972+0000 7fadd65e5740 1 client.5919 shutdown 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 msgr2=0x55c2e1ad8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003f20 tx=0x7fadc0009260 comp rx=0 tx=0).stop 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 shutdown_connections 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1aeab10 0x55c2e1aeaf10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1ade0d0 0x55c2e1aca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1a98d00 0x55c2e1aca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1375352724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ad8f60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadb2000640 0 client.5919 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:43.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 >> 172.21.15.81:0/1375352724 conn(0x55c2e1a95bc0 msgr2=0x55c2e1a99ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 shutdown_connections 2024-09-11T01:11:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 1 -- 172.21.15.81:0/1375352724 wait complete. 2024-09-11T01:11:43.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.973+0000 7fadd65e5740 20 client.5919 trim_cache size 0 max 16384 2024-09-11T01:11:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.991+0000 7fadd65e5740 1 Processor -- start 2024-09-11T01:11:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.991+0000 7fadd65e5740 1 -- start start 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.991+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.991+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a97af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1afe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd65e5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e1acc3c0 con 0x55c2e1a98360 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ff450 con 0x55c2e1a98d00 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc1fe330 con 0x55c2e1ade0d0 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33136/0 (socket says 172.21.15.81:33136) 2024-09-11T01:11:43.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 -- 172.21.15.81:0/1275140114 learned_addr learned my addr 172.21.15.81:0/1275140114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 -- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 msgr2=0x55c2e1afe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1afe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 -- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 msgr2=0x55c2e1a97af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a97af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 -- 172.21.15.81:0/1275140114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e1adbab0 con 0x55c2e1a98360 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadd0e00640 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009230 tx=0x7fadc00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ce23eff7fa96ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.992+0000 7fadbcc00640 1 -- 172.21.15.81:0/1275140114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc004e070 con 0x55c2e1a98360 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadbcc00640 1 -- 172.21.15.81:0/1275140114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc004f040 con 0x55c2e1a98360 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadbcc00640 1 -- 172.21.15.81:0/1275140114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0035040 con 0x55c2e1a98360 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 -- 172.21.15.81:0/1275140114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 msgr2=0x55c2e1a975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009230 tx=0x7fadc00045e0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 -- 172.21.15.81:0/1275140114 shutdown_connections 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1afe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1a97af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 --2- 172.21.15.81:0/1275140114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1a975b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 -- 172.21.15.81:0/1275140114 >> 172.21.15.81:0/1275140114 conn(0x55c2e1a95bc0 msgr2=0x55c2e1aeda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.993+0000 7fadd65e5740 1 -- 172.21.15.81:0/1275140114 shutdown_connections 2024-09-11T01:11:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.994+0000 7fadd65e5740 1 -- 172.21.15.81:0/1275140114 wait complete. 2024-09-11T01:11:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.994+0000 7fadd65e5740 1 -- start start 2024-09-11T01:11:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.994+0000 7fadd65e5740 1 Processor -- start 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1acb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1b54be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1fdc60 con 0x55c2e1a98360 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1f4a60 con 0x55c2e1a98d00 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc1fcf20 con 0x55c2e1ade0d0 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd65e5740 10 client.0 _ll_register_callbacks cb 0x7fadc00036d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.995+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33140/0 (socket says 172.21.15.81:33140) 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 -- 172.21.15.81:0/405309323 learned_addr learned my addr 172.21.15.81:0/405309323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadcbe00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1acb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd1800640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1b54be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 -- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 msgr2=0x55c2e1b54be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1b54be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 -- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 msgr2=0x55c2e1acb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1acb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 -- 172.21.15.81:0/405309323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e1ac8f50 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd0e00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003f20 tx=0x7fadc004b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5878ba79da53b69d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadb2000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0065060 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fadc004bca0 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.996+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc004f040 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fadc0035070 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 10 client.5925 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c2e1ad9a00 con 0x55c2e1a98360 2024-09-11T01:11:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc004f040 con 0x55c2e1a98360 2024-09-11T01:11:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fadc005d070 con 0x55c2e1a98360 2024-09-11T01:11:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 10 client.5925 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 10 client.5925 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 20 client.5925 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1ac9e50 0x55c2e1b55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:44.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 4 client.5925 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.45, "await_for": 45.0}] 2024-09-11T01:11:44.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.997+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.45, "await_for": 45.0}) -- 0x55c2e1a0ac40 con 0x55c2e1ac9e50 2024-09-11T01:11:44.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.998+0000 7fadcbe00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1ac9e50 0x55c2e1b55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:44.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.998+0000 7fadcbe00640 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1ac9e50 0x55c2e1b55120 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5c3dc9b2484506 server_cookie=77ca9df74f6c270 in_seq=0 out_seq=0 2024-09-11T01:11:44.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:43.998+0000 7fadb2000640 10 client.5925 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.536+0000 7fadb2000640 1 -- 172.21.15.81:0/405309323 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c2e1a0ac40 con 0x55c2e1ac9e50 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.536+0000 7fadb2000640 10 client.5925 handle_command_reply: tid=0 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.536+0000 7fadd65e5740 1 client.5925 shutdown 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 msgr2=0x55c2e1ac8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003f20 tx=0x7fadc004b720 comp rx=0 tx=0).stop 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 shutdown_connections 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55c2e1ac9e50 0x55c2e1b55120 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c2e1ade0d0 0x55c2e1b54be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c2e1a98d00 0x55c2e1acb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadb2000640 0 client.5925 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 --2- 172.21.15.81:0/405309323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e1a98360 0x55c2e1ac8a10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 >> 172.21.15.81:0/405309323 conn(0x55c2e1a95bc0 msgr2=0x55c2e1a97770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 shutdown_connections 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 1 -- 172.21.15.81:0/405309323 wait complete. 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.537+0000 7fadd65e5740 20 client.5925 trim_cache size 0 max 16384 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:11:47.541 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 86, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "36d04781": { 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 86, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:11:47.542 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:47.543 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 msgr2=0x7fadac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 0x7fadac07a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadc00096c0 tx=0x7fadc0004730 comp rx=0 tx=0).stop 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 msgr2=0x7fadcc14aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc14aac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fadc400e990 tx=0x7fadc400ee50 comp rx=0 tx=0).stop 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 shutdown_connections 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fadac077fa0 0x7fadac07a460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadcc154810 0x7fadcc14aac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadcc0cc030 0x7fadcc0c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 --2- 172.21.15.81:0/481048828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc0c4f60 0x7fadcc1e7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 >> 172.21.15.81:0/481048828 conn(0x7fadcc0688e0 msgr2=0x7fadcc158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 shutdown_connections 2024-09-11T01:11:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:47.538+0000 7fadd2200640 1 -- 172.21.15.81:0/481048828 wait complete. 2024-09-11T01:11:47.559 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '36d04781', quiesce took 19.2 seconds. Will release after: 9.25 2024-09-11T01:11:56.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:11:56.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 -- 172.21.15.81:0/480321791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 msgr2=0x7fc4a0151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:56.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 --2- 172.21.15.81:0/480321791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0151790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc4a006e0c0 tx=0x7fc49002a5f0 comp rx=0 tx=0).stop 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 -- 172.21.15.81:0/480321791 shutdown_connections 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 --2- 172.21.15.81:0/480321791 >> v2:172.21.15.167:3300/0 conn(0x7fc4a0157f80 0x7fc4a0161d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 --2- 172.21.15.81:0/480321791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0151790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 -- 172.21.15.81:0/480321791 >> 172.21.15.81:0/480321791 conn(0x7fc4a00700f0 msgr2=0x7fc4a0070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 -- 172.21.15.81:0/480321791 shutdown_connections 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.985+0000 7fc4a5000640 1 -- 172.21.15.81:0/480321791 wait complete. 2024-09-11T01:11:56.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.986+0000 7fc4a5000640 1 Processor -- start 2024-09-11T01:11:56.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.986+0000 7fc4a5000640 1 -- start start 2024-09-11T01:11:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0157b30 0x7fc4a01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0157f80 0x7fc4a01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00c83a0 con 0x7fc4a01513b0 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01576a0 con 0x7fc4a0157b30 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.987+0000 7fc4a5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a006ebd0 con 0x7fc4a0157f80 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50278/0 (socket says 172.21.15.81:50278) 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 -- 172.21.15.81:0/2292172301 learned_addr learned my addr 172.21.15.81:0/2292172301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49d400640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0157b30 0x7fc4a01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49e800640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0157f80 0x7fc4a01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 -- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0157f80 msgr2=0x7fc4a01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0157f80 0x7fc4a01548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 -- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0157b30 msgr2=0x7fc4a01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0157b30 0x7fc4a01587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 -- 172.21.15.81:0/2292172301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a0158d10 con 0x7fc4a01513b0 2024-09-11T01:11:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.988+0000 7fc49de00640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc490034040 tx=0x7fc4900039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.989+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49003e030 con 0x7fc4a01513b0 2024-09-11T01:11:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.989+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4900047a0 con 0x7fc4a01513b0 2024-09-11T01:11:56.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.989+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490035040 con 0x7fc4a01513b0 2024-09-11T01:11:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.989+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a015a320 con 0x7fc4a01513b0 2024-09-11T01:11:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.989+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01f0dc0 con 0x7fc4a01513b0 2024-09-11T01:11:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.990+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a01511d0 con 0x7fc4a01513b0 2024-09-11T01:11:56.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.991+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc490004b70 con 0x7fc4a01513b0 2024-09-11T01:11:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.992+0000 7fc496000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 0x7fc48007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.992+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc4900baba0 con 0x7fc4a01513b0 2024-09-11T01:11:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.992+0000 7fc49d400640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 0x7fc48007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:56.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.993+0000 7fc49d400640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 0x7fc48007a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c008040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:56.996+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc4a01511d0 con 0x7fc4a01513b0 2024-09-11T01:11:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.213+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a006f5e0 con 0x7fc4a01513b0 2024-09-11T01:11:57.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.213+0000 7fc496000640 1 -- 172.21.15.81:0/2292172301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7fc490083290 con 0x7fc4a01513b0 2024-09-11T01:11:57.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:11:57.216 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:11:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 msgr2=0x7fc48007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 0x7fc48007a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc48c006fd0 tx=0x7fc48c008040 comp rx=0 tx=0).stop 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 msgr2=0x7fc4a0152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc490034040 tx=0x7fc4900039e0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 shutdown_connections 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc480077f70 0x7fc48007a430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0157f80 0x7fc4a01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0157b30 0x7fc4a01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 --2- 172.21.15.81:0/2292172301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a01513b0 0x7fc4a0152c90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.215+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 >> 172.21.15.81:0/2292172301 conn(0x7fc4a00700f0 msgr2=0x7fc4a00744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.216+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 shutdown_connections 2024-09-11T01:11:57.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.216+0000 7fc4a5000640 1 -- 172.21.15.81:0/2292172301 wait complete. 2024-09-11T01:11:57.234 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id 36d04781 --release --await' 2024-09-11T01:11:57.234 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id 36d04781 --release --await 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 -- 172.21.15.81:0/2867364229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c152550 msgr2=0x7fbd7c074dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 --2- 172.21.15.81:0/2867364229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c152550 0x7fbd7c074dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c005fd0 tx=0x7fbd6c02ab20 comp rx=0 tx=0).stop 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 -- 172.21.15.81:0/2867364229 shutdown_connections 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 --2- 172.21.15.81:0/2867364229 >> v2:172.21.15.167:3300/0 conn(0x7fbd7c152930 0x7fbd7c0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 --2- 172.21.15.81:0/2867364229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c152550 0x7fbd7c074dd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 -- 172.21.15.81:0/2867364229 >> 172.21.15.81:0/2867364229 conn(0x7fbd7c0c8990 msgr2=0x7fbd7c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 -- 172.21.15.81:0/2867364229 shutdown_connections 2024-09-11T01:11:57.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.396+0000 7fbd81c00640 1 -- 172.21.15.81:0/2867364229 wait complete. 2024-09-11T01:11:57.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.398+0000 7fbd81c00640 1 Processor -- start 2024-09-11T01:11:57.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.398+0000 7fbd81c00640 1 -- start start 2024-09-11T01:11:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c0c94b0 0x7fbd7c0c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c152550 0x7fbd7c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c0c73c0 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c158df0 con 0x7fbd7c152550 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c0c5eb0 con 0x7fbd7c0c94b0 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50288/0 (socket says 172.21.15.81:50288) 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 -- 172.21.15.81:0/168287430 learned_addr learned my addr 172.21.15.81:0/168287430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd7be00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c0c94b0 0x7fbd7c0c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd7b400640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c152550 0x7fbd7c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 -- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c0c94b0 msgr2=0x7fbd7c0c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c0c94b0 0x7fbd7c0c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 -- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c152550 msgr2=0x7fbd7c148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c152550 0x7fbd7c148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.399+0000 7fbd81200640 1 -- 172.21.15.81:0/168287430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c0c2c30 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd81200640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c3c0 tx=0x7fbd7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd73e00640 1 -- 172.21.15.81:0/168287430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74017070 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd73e00640 1 -- 172.21.15.81:0/168287430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd740053c0 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd73e00640 1 -- 172.21.15.81:0/168287430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74003850 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7c14cb00 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.400+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7c1f4310 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.402+0000 7fbd73e00640 1 -- 172.21.15.81:0/168287430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbd740039f0 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.403+0000 7fbd73e00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 0x7fbd5c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd73e00640 1 -- 172.21.15.81:0/168287430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbd740996a0 con 0x7fbd7c1f0ad0 2024-09-11T01:11:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 Processor -- start 2024-09-11T01:11:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 -- start start 2024-09-11T01:11:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd7be00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 0x7fbd5c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfe8a20 0x55742cfde5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa3b20 0x55742cfdeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd7be00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 0x7fbd5c07a460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c035000 tx=0x7fbd6c038040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55742cf1b370 con 0x55742cfa6d90 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55742cf0a7a0 con 0x55742cfa3b20 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.404+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55742cf0e5b0 con 0x55742cfe8a20 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50302/0 (socket says 172.21.15.81:50302) 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 -- 172.21.15.81:0/4009381380 learned_addr learned my addr 172.21.15.81:0/4009381380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd81200640 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa3b20 0x55742cfdeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7b400640 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfe8a20 0x55742cfde5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 -- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfe8a20 msgr2=0x55742cfde5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfe8a20 0x55742cfde5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 -- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa3b20 msgr2=0x55742cfdeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa3b20 0x55742cfdeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 -- 172.21.15.81:0/4009381380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55742cea3010 con 0x55742cfa6d90 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.405+0000 7fbd7be00640 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c02b110 tx=0x7fbd6c02ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf3a572cc1b81d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd70c00640 1 -- 172.21.15.81:0/4009381380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02c880 con 0x55742cfa6d90 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd70c00640 1 -- 172.21.15.81:0/4009381380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd6c051070 con 0x55742cfa6d90 2024-09-11T01:11:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd70c00640 1 -- 172.21.15.81:0/4009381380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02ccc0 con 0x55742cfa6d90 2024-09-11T01:11:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 -- 172.21.15.81:0/4009381380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 msgr2=0x55742cff1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c02b110 tx=0x7fbd6c02ab20 comp rx=0 tx=0).stop 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 -- 172.21.15.81:0/4009381380 shutdown_connections 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa3b20 0x55742cfdeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfe8a20 0x55742cfde5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 --2- 172.21.15.81:0/4009381380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfa6d90 0x55742cff1e30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.406+0000 7fbd861f8740 1 -- 172.21.15.81:0/4009381380 >> 172.21.15.81:0/4009381380 conn(0x55742cfa4f70 msgr2=0x55742cfa6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.407+0000 7fbd861f8740 1 -- 172.21.15.81:0/4009381380 shutdown_connections 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.407+0000 7fbd861f8740 1 -- 172.21.15.81:0/4009381380 wait complete. 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.407+0000 7fbd861f8740 1 -- start start 2024-09-11T01:11:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.407+0000 7fbd861f8740 1 Processor -- start 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfe8a20 0x55742cfef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 0x55742cfdc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55742ceb1f70 con 0x55742cfedbc0 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55742ceb0090 con 0x55742cfe8a20 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55742cfefa20 con 0x55742cfa6d90 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.408+0000 7fbd861f8740 10 client.0 _ll_register_callbacks cb 0x55742cc19110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 0x55742cfdc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd7b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfe8a20 0x55742cfef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:37102/0 (socket says 172.21.15.81:37102) 2024-09-11T01:11:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd7be00640 1 -- 172.21.15.81:0/2942918222 learned_addr learned my addr 172.21.15.81:0/2942918222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 -- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 msgr2=0x55742cfdef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 -- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfe8a20 msgr2=0x55742cfef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfe8a20 0x55742cfef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 -- 172.21.15.81:0/2942918222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55742cc6cea0 con 0x55742cfedbc0 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd7be00640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd81200640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 0x55742cfdc230 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbd74061440 tx=0x7fbd74060eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a79b07a6cb645f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd65600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74066170 con 0x55742cfedbc0 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6c051070 con 0x55742cfedbc0 2024-09-11T01:11:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.409+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbd74087180 con 0x55742cfedbc0 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbd7406ab90 con 0x55742cfedbc0 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 10 client.5940 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55742cce5d30 con 0x55742cfedbc0 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd6c051070 con 0x55742cfedbc0 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbd74091c30 con 0x55742cfedbc0 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 10 client.5940 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 10 client.5940 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 20 client.5940 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742cfed220 0x55742cfdb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 4 client.5940 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.410+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55742cf1d2c0 con 0x55742cfed220 2024-09-11T01:11:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.411+0000 7fbd7be00640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742cfed220 0x55742cfdb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.411+0000 7fbd7be00640 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742cfed220 0x55742cfdb8d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f77bb19dd5bcc0a server_cookie=4f96bc9ca417f2f9 in_seq=0 out_seq=0 2024-09-11T01:11:57.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.411+0000 7fbd65600640 10 client.5940 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd65600640 1 -- 172.21.15.81:0/2942918222 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55742cf1d2c0 con 0x55742cfed220 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd65600640 10 client.5940 handle_command_reply: tid=0 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 client.5940 shutdown 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 msgr2=0x55742cfdc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 0x55742cfdc230 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbd74061440 tx=0x7fbd74060eb0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 shutdown_connections 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742cfed220 0x55742cfdb8d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd65600640 0 client.5940 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.412+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfedbc0 0x55742cfdc230 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfe8a20 0x55742cfef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2942918222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfdef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 >> 172.21.15.81:0/2942918222 conn(0x55742cfa3b20 msgr2=0x55742cfa27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 shutdown_connections 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 1 -- 172.21.15.81:0/2942918222 wait complete. 2024-09-11T01:11:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.413+0000 7fbd861f8740 20 client.5940 trim_cache size 0 max 16384 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.431+0000 7fbd861f8740 1 Processor -- start 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.431+0000 7fbd861f8740 1 -- start start 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742cfd15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfedbc0 0x55742cfd1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1ff2e0 con 0x55742cfe8a20 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1fe1c0 con 0x55742cfedbc0 2024-09-11T01:11:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c1fc7a0 con 0x55742cfa6d90 2024-09-11T01:11:57.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742cfd15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:37108/0 (socket says 172.21.15.81:37108) 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7be00640 1 -- 172.21.15.81:0/2182457096 learned_addr learned my addr 172.21.15.81:0/2182457096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd81200640 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfedbc0 0x55742cfd1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 -- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 msgr2=0x55742cfeeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 -- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfedbc0 msgr2=0x55742cfd1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfedbc0 0x55742cfd1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 -- 172.21.15.81:0/2182457096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55742cfa5360 con 0x55742cfe8a20 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7be00640 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.432+0000 7fbd7b400640 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742cfd15c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55742cea9f30 tx=0x7fbd68005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536bd6134bb9384e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd67e00640 1 -- 172.21.15.81:0/2182457096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680120d0 con 0x55742cfe8a20 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd67e00640 1 -- 172.21.15.81:0/2182457096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd68012270 con 0x55742cfe8a20 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd67e00640 1 -- 172.21.15.81:0/2182457096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68004270 con 0x55742cfe8a20 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 -- 172.21.15.81:0/2182457096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 msgr2=0x55742cfd15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742cfd15c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55742cea9f30 tx=0x7fbd68005f90 comp rx=0 tx=0).stop 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 -- 172.21.15.81:0/2182457096 shutdown_connections 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfedbc0 0x55742cfd1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742cfd15c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 --2- 172.21.15.81:0/2182457096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfa6d90 0x55742cfeeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 -- 172.21.15.81:0/2182457096 >> 172.21.15.81:0/2182457096 conn(0x55742cfa3b20 msgr2=0x55742cfdb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 -- 172.21.15.81:0/2182457096 shutdown_connections 2024-09-11T01:11:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.433+0000 7fbd861f8740 1 -- 172.21.15.81:0/2182457096 wait complete. 2024-09-11T01:11:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.434+0000 7fbd861f8740 1 -- start start 2024-09-11T01:11:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.434+0000 7fbd861f8740 1 Processor -- start 2024-09-11T01:11:57.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa6d90 0x55742cfd4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfedbc0 0x55742d067b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1fcdf0 con 0x55742cfe8a20 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c1fdaf0 con 0x55742cfa6d90 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c1fd440 con 0x55742cfedbc0 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd861f8740 10 client.0 _ll_register_callbacks cb 0x7fbd74061090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd7b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd7b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50332/0 (socket says 172.21.15.81:50332) 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.435+0000 7fbd7b400640 1 -- 172.21.15.81:0/1955668927 learned_addr learned my addr 172.21.15.81:0/1955668927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd81200640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfedbc0 0x55742d067b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7be00640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa6d90 0x55742cfd4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 -- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfedbc0 msgr2=0x55742d067b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfedbc0 0x55742d067b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 -- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa6d90 msgr2=0x55742cfd4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa6d90 0x55742cfd4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 -- 172.21.15.81:0/1955668927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55742cfdc7e0 con 0x55742cfe8a20 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd7b400640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c072880 tx=0x7fbd68009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71529e4188deffeb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd65600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680120d0 con 0x55742cfe8a20 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbd68005220 con 0x55742cfe8a20 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.436+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd68012270 con 0x55742cfe8a20 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbd68034050 con 0x55742cfe8a20 2024-09-11T01:11:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 10 client.5946 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55742cfd1d00 con 0x55742cfe8a20 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd68012270 con 0x55742cfe8a20 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbd68037020 con 0x55742cfe8a20 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 10 client.5946 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 10 client.5946 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 20 client.5946 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742d00cfa0 0x55742cfefbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 4 client.5946 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "36d04781", "release": true, "await": true}] 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "36d04781", "release": true, "await": true}) -- 0x55742cf18d70 con 0x55742d00cfa0 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.437+0000 7fbd7be00640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742d00cfa0 0x55742cfefbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.438+0000 7fbd7be00640 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742d00cfa0 0x55742cfefbb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=373ae7269b504094 server_cookie=fef122c51682f53c in_seq=0 out_seq=0 2024-09-11T01:11:57.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.438+0000 7fbd65600640 10 client.5946 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd65600640 1 -- 172.21.15.81:0/1955668927 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55742cf18d70 con 0x55742d00cfa0 2024-09-11T01:11:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd65600640 10 client.5946 handle_command_reply: tid=0 2024-09-11T01:11:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 client.5946 shutdown 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 msgr2=0x55742d0675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c072880 tx=0x7fbd68009540 comp rx=0 tx=0).stop 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 shutdown_connections 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55742d00cfa0 0x55742cfefbb0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55742cfedbc0 0x55742d067b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55742cfe8a20 0x55742d0675d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 --2- 172.21.15.81:0/1955668927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55742cfa6d90 0x55742cfd4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 >> 172.21.15.81:0/1955668927 conn(0x55742cfa3b20 msgr2=0x55742cf9e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.458+0000 7fbd65600640 0 client.5946 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 shutdown_connections 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd861f8740 1 -- 172.21.15.81:0/1955668927 wait complete. 2024-09-11T01:11:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd861f8740 20 client.5946 trim_cache size 0 max 16384 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 88, 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "36d04781": { 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 88, 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:11:57.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:57.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:11:57.465 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:11:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 msgr2=0x7fbd5c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 0x7fbd5c07a460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c035000 tx=0x7fbd6c038040 comp rx=0 tx=0).stop 2024-09-11T01:11:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 msgr2=0x7fbd7c0c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c3c0 tx=0x7fbd7400c880 comp rx=0 tx=0).stop 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 shutdown_connections 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbd5c077fa0 0x7fbd5c07a460 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c1f0ad0 0x7fbd7c0c4190 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd7c152550 0x7fbd7c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 --2- 172.21.15.81:0/168287430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd7c0c94b0 0x7fbd7c0c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 >> 172.21.15.81:0/168287430 conn(0x7fbd7c0c8990 msgr2=0x7fbd7c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.459+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 shutdown_connections 2024-09-11T01:11:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.460+0000 7fbd81c00640 1 -- 172.21.15.81:0/168287430 wait complete. 2024-09-11T01:11:57.478 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '36d04781', total seconds elapsed: 29.1 2024-09-11T01:11:57.478 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.45 2024-09-11T01:11:57.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 -- 172.21.15.81:0/534081407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7910157f50 msgr2=0x7f7910161d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 --2- 172.21.15.81:0/534081407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7910157f50 0x7f7910161d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fd0 tx=0x7f790802ab20 comp rx=0 tx=0).stop 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 -- 172.21.15.81:0/534081407 shutdown_connections 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 --2- 172.21.15.81:0/534081407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7910157f50 0x7f7910161d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 --2- 172.21.15.81:0/534081407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79101513b0 0x7f7910151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 -- 172.21.15.81:0/534081407 >> 172.21.15.81:0/534081407 conn(0x7f79100700f0 msgr2=0x7f7910070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 -- 172.21.15.81:0/534081407 shutdown_connections 2024-09-11T01:11:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.638+0000 7f7917c00640 1 -- 172.21.15.81:0/534081407 wait complete. 2024-09-11T01:11:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.640+0000 7f7917c00640 1 Processor -- start 2024-09-11T01:11:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.640+0000 7f7917c00640 1 -- start start 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7910157b30 0x7f791014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7910157f50 0x7f7910148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79100c83a0 con 0x7f79101513b0 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7910158380 con 0x7f7910157b30 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7917c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f791006ebd0 con 0x7f7910157f50 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50348/0 (socket says 172.21.15.81:50348) 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 -- 172.21.15.81:0/1211161357 learned_addr learned my addr 172.21.15.81:0/1211161357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 -- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7910157f50 msgr2=0x7f7910148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7910157f50 0x7f7910148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 -- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7910157b30 msgr2=0x7f791014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7910157b30 0x7f791014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 -- 172.21.15.81:0/1211161357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79100c6cb0 con 0x7f79101513b0 2024-09-11T01:11:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.641+0000 7f7915200640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f790400e790 tx=0x7f790400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.642+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790400eea0 con 0x7f79101513b0 2024-09-11T01:11:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.642+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f790400cdb0 con 0x7f79101513b0 2024-09-11T01:11:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.642+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904010690 con 0x7f79101513b0 2024-09-11T01:11:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.642+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79101e1ba0 con 0x7f79101513b0 2024-09-11T01:11:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.642+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101e2140 con 0x7f79101513b0 2024-09-11T01:11:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.643+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7910071b70 con 0x7f79101513b0 2024-09-11T01:11:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.645+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7904010830 con 0x7f79101513b0 2024-09-11T01:11:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.646+0000 7f790cc00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 0x7f78f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.646+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f790409abf0 con 0x7f79101513b0 2024-09-11T01:11:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.647+0000 7f790fe00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 0x7f78f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.647+0000 7f790fe00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 0x7f78f007a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79101ef3f0 tx=0x7f78fc0078d0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.650+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7910071b70 con 0x7f79101513b0 2024-09-11T01:11:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.881+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f791006f5e0 con 0x7f79101513b0 2024-09-11T01:11:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.883+0000 7f790cc00640 1 -- 172.21.15.81:0/1211161357 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f79040632e0 con 0x7f79101513b0 2024-09-11T01:11:57.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:11:57.886 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:11:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 msgr2=0x7f78f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 0x7f78f007a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79101ef3f0 tx=0x7f78fc0078d0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 msgr2=0x7f791014c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f790400e790 tx=0x7f790400ec50 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 shutdown_connections 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f78f0077f70 0x7f78f007a430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7910157f50 0x7f7910148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7910157b30 0x7f791014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 --2- 172.21.15.81:0/1211161357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79101513b0 0x7f791014c400 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 >> 172.21.15.81:0/1211161357 conn(0x7f79100700f0 msgr2=0x7f7910072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 shutdown_connections 2024-09-11T01:11:57.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:57.886+0000 7f7917c00640 1 -- 172.21.15.81:0/1211161357 wait complete. 2024-09-11T01:11:57.905 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db / --timeout 90 --expiration 148.45 --await-for 45.0' 2024-09-11T01:11:57.905 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db / --timeout 90 --expiration 148.45 --await-for 45.0 2024-09-11T01:11:58.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.078+0000 7fbc70a00640 1 -- 172.21.15.81:0/144264716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cc1c0 msgr2=0x7fbc6c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.078+0000 7fbc70a00640 1 --2- 172.21.15.81:0/144264716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c0ccd80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005fd0 tx=0x7fbc5802a540 comp rx=0 tx=0).stop 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 -- 172.21.15.81:0/144264716 shutdown_connections 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 --2- 172.21.15.81:0/144264716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c0cd2c0 0x7fbc6c164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 --2- 172.21.15.81:0/144264716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c0ccd80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 -- 172.21.15.81:0/144264716 >> 172.21.15.81:0/144264716 conn(0x7fbc6c06ee50 msgr2=0x7fbc6c06f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 -- 172.21.15.81:0/144264716 shutdown_connections 2024-09-11T01:11:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.079+0000 7fbc70a00640 1 -- 172.21.15.81:0/144264716 wait complete. 2024-09-11T01:11:58.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.080+0000 7fbc70a00640 1 Processor -- start 2024-09-11T01:11:58.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.080+0000 7fbc70a00640 1 -- start start 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 0x7fbc6c14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 0x7fbc6c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0693d0 con 0x7fbc6c0cd2c0 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0690f0 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.081+0000 7fbc70a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c0c5650 con 0x7fbc6c154860 2024-09-11T01:11:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 0x7fbc6c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 0x7fbc6c14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.81:58284/0 (socket says 172.21.15.81:58284) 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 -- 172.21.15.81:0/1510420441 learned_addr learned my addr 172.21.15.81:0/1510420441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 -- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 msgr2=0x7fbc6c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 0x7fbc6c14f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 -- 172.21.15.81:0/1510420441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 msgr2=0x7fbc6c14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 0x7fbc6c14ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6b400640 1 -- 172.21.15.81:0/1510420441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c149100 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 0x7fbc6c14ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.082+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 0x7fbc6c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b3f0 tx=0x7fbc5c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc63400640 1 -- 172.21.15.81:0/1510420441 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c015020 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc63400640 1 -- 172.21.15.81:0/1510420441 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc5c011920 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c1f4680 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc63400640 1 -- 172.21.15.81:0/1510420441 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c011d70 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.083+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c1f0650 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.087+0000 7fbc7505e740 1 Processor -- start 2024-09-11T01:11:58.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.087+0000 7fbc63400640 1 -- 172.21.15.81:0/1510420441 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc5c01a400 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.087+0000 7fbc7505e740 1 -- start start 2024-09-11T01:11:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220612680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220616d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55922058a240 con 0x559220615360 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559220579670 con 0x559220615d00 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55922057d480 con 0x559220612bc0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.088+0000 7fbc63400640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 0x7fbc4c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc63400640 1 -- 172.21.15.81:0/1510420441 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbc5c099ff0 con 0x7fbc6c0cc1c0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220612680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220616d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:37160/0 (socket says 172.21.15.81:37160) 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 -- 172.21.15.81:0/3875476240 learned_addr learned my addr 172.21.15.81:0/3875476240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 0x7fbc4c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 -- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 msgr2=0x559220616d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220616d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 -- 172.21.15.81:0/3875476240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 msgr2=0x559220612680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220612680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.089+0000 7fbc6aa00640 1 -- 172.21.15.81:0/3875476240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559220353de0 con 0x559220612bc0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc580099f0 tx=0x7fbc580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d268fee78ccd8dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 0x7fbc4c07a460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007fd0 tx=0x7fbc64004ab0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc57400640 1 -- 172.21.15.81:0/3875476240 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58040070 con 0x559220612bc0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc57400640 1 -- 172.21.15.81:0/3875476240 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc58003ba0 con 0x559220612bc0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc57400640 1 -- 172.21.15.81:0/3875476240 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58035040 con 0x559220612bc0 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc7505e740 1 -- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 msgr2=0x5592206172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.090+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc580099f0 tx=0x7fbc580046c0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 -- 172.21.15.81:0/3875476240 shutdown_connections 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220612bc0 0x5592206172b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220616d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3875476240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220612680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 -- 172.21.15.81:0/3875476240 >> 172.21.15.81:0/3875476240 conn(0x559220613500 msgr2=0x5592206149e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 -- 172.21.15.81:0/3875476240 shutdown_connections 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 -- 172.21.15.81:0/3875476240 wait complete. 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.091+0000 7fbc7505e740 1 -- start start 2024-09-11T01:11:58.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.092+0000 7fbc7505e740 1 Processor -- start 2024-09-11T01:11:58.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220649ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x55922065a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592202e9d20 con 0x559220615d00 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55922051edd0 con 0x559220649460 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x559220611fc0 con 0x559220615360 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc7505e740 10 client.0 _ll_register_callbacks cb 0x5592202871c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50398/0 (socket says 172.21.15.81:50398) 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 -- 172.21.15.81:0/1540991218 learned_addr learned my addr 172.21.15.81:0/1540991218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220649ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 -- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 msgr2=0x559220649ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220649ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 -- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 msgr2=0x55922065a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x55922065a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6aa00640 1 -- 172.21.15.81:0/1540991218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592203b4570 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.093+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220649ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009230 tx=0x7fbc58003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4088cab1a744b49a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58040070 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbc58045670 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc58003ba0 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbc58054050 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc7505e740 10 client.5967 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5592202b8c80 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc58003ba0 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.094+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbc58057020 con 0x559220615d00 2024-09-11T01:11:58.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 10 client.5967 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 10 client.5967 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 20 client.5967 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55922066b790 0x55922066bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 4 client.5967 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55922058c190 con 0x55922066b790 2024-09-11T01:11:58.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.095+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55922066b790 0x55922066bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.096+0000 7fbc4be00640 10 client.5967 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.096+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55922066b790 0x55922066bc10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=545d5e1e2a27ebce server_cookie=1d86912fe531e7d0 in_seq=0 out_seq=0 2024-09-11T01:11:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.096+0000 7fbc4be00640 1 -- 172.21.15.81:0/1540991218 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55922058c190 con 0x55922066b790 2024-09-11T01:11:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.096+0000 7fbc4be00640 10 client.5967 handle_command_reply: tid=0 2024-09-11T01:11:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 client.5967 shutdown 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 msgr2=0x559220659d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009230 tx=0x7fbc58003f80 comp rx=0 tx=0).stop 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 shutdown_connections 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x55922066b790 0x55922066bc10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x55922065a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615d00 0x559220659d20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1540991218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220649ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 >> 172.21.15.81:0/1540991218 conn(0x559220612bc0 msgr2=0x55922064d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc4be00640 0 client.5967 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 shutdown_connections 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 1 -- 172.21.15.81:0/1540991218 wait complete. 2024-09-11T01:11:58.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.097+0000 7fbc7505e740 20 client.5967 trim_cache size 0 max 16384 2024-09-11T01:11:58.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.116+0000 7fbc7505e740 1 Processor -- start 2024-09-11T01:11:58.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.116+0000 7fbc7505e740 1 -- start start 2024-09-11T01:11:58.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 0x5592206145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x559220614af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592206164a0 con 0x559220615360 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ff250 con 0x559220649460 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c1fe130 con 0x559220615d00 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50412/0 (socket says 172.21.15.81:50412) 2024-09-11T01:11:58.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.117+0000 7fbc6b400640 1 -- 172.21.15.81:0/3194101538 learned_addr learned my addr 172.21.15.81:0/3194101538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 -- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 msgr2=0x5592206145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 0x5592206145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6be00640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x559220614af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 0x5592206145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 -- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 msgr2=0x559220614af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x559220614af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 -- 172.21.15.81:0/3194101538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559220613b20 con 0x559220615360 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6be00640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x559220614af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 0x5592206145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc6b400640 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c05f290 tx=0x7fbc5c061ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3251ba28dde381c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc56a00640 1 -- 172.21.15.81:0/3194101538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c097020 con 0x559220615360 2024-09-11T01:11:58.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc56a00640 1 -- 172.21.15.81:0/3194101538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc5c05e290 con 0x559220615360 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.118+0000 7fbc56a00640 1 -- 172.21.15.81:0/3194101538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c0614e0 con 0x559220615360 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 -- 172.21.15.81:0/3194101538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 msgr2=0x559220649d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c05f290 tx=0x7fbc5c061ef0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 -- 172.21.15.81:0/3194101538 shutdown_connections 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220649460 0x559220614af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615d00 0x5592206145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 --2- 172.21.15.81:0/3194101538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220615360 0x559220649d70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 -- 172.21.15.81:0/3194101538 >> 172.21.15.81:0/3194101538 conn(0x559220612bc0 msgr2=0x55922064d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 -- 172.21.15.81:0/3194101538 shutdown_connections 2024-09-11T01:11:58.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.119+0000 7fbc7505e740 1 -- 172.21.15.81:0/3194101538 wait complete. 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.120+0000 7fbc7505e740 1 -- start start 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.120+0000 7fbc7505e740 1 Processor -- start 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220658f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220648a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1fda60 con 0x559220649460 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1fc760 con 0x559220615d00 2024-09-11T01:11:58.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c1fcdb0 con 0x559220615360 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc7505e740 10 client.0 _ll_register_callbacks cb 0x7fbc64014630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50422/0 (socket says 172.21.15.81:50422) 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.121+0000 7fbc6be00640 1 -- 172.21.15.81:0/1501732300 learned_addr learned my addr 172.21.15.81:0/1501732300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220658f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220648a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 -- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 msgr2=0x559220658f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220658f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 -- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 msgr2=0x559220648a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220648a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 -- 172.21.15.81:0/1501732300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559220672410 con 0x559220649460 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6aa00640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220648a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc6be00640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbc64013a10 tx=0x7fbc64007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3bbc228e8d1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:58.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc4be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64025070 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fbc6400fd50 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc5c05e290 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbc6402f050 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc7505e740 10 client.5973 fetch_fsmap learned FSMap version 9 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.122+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x559220648f50 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc5c05e290 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbc64004b20 con 0x559220649460 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 10 client.5973 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 10 client.5973 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 20 client.5973 populate_metadata read hostname 'smithi081' 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559220647c20 0x559220648030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:58.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 4 client.5973 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.45, "await_for": 45.0}] 2024-09-11T01:11:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.45, "await_for": 45.0}) -- 0x559220656120 con 0x559220647c20 2024-09-11T01:11:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.123+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559220647c20 0x559220648030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.124+0000 7fbc4be00640 10 client.5973 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:11:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:11:58.124+0000 7fbc6b400640 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559220647c20 0x559220648030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6685fe7837572b server_cookie=c098733d2f0cdcad in_seq=0 out_seq=0 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc4be00640 1 -- 172.21.15.81:0/1501732300 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559220656120 con 0x559220647c20 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc4be00640 10 client.5973 handle_command_reply: tid=0 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 client.5973 shutdown 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 msgr2=0x5592206476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbc64013a10 tx=0x7fbc64007e20 comp rx=0 tx=0).stop 2024-09-11T01:12:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 shutdown_connections 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x559220647c20 0x559220648030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559220649460 0x5592206476e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559220615d00 0x559220648a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 --2- 172.21.15.81:0/1501732300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559220615360 0x559220658f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc4be00640 0 client.5973 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 >> 172.21.15.81:0/1501732300 conn(0x559220612bc0 msgr2=0x559220641530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 shutdown_connections 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.471+0000 7fbc7505e740 1 -- 172.21.15.81:0/1501732300 wait complete. 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.472+0000 7fbc7505e740 20 client.5973 trim_cache size 0 max 16384 2024-09-11T01:12:02.475 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 90, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "ee045169": { 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 90, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:12:02.476 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:02.477 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.472+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 msgr2=0x7fbc4c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.472+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 0x7fbc4c07a460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007fd0 tx=0x7fbc64004ab0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.472+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 msgr2=0x7fbc6c148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.472+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b3f0 tx=0x7fbc5c00b8b0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 shutdown_connections 2024-09-11T01:12:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fbc4c077fa0 0x7fbc4c07a460 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc6c154860 0x7fbc6c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6c0cd2c0 0x7fbc6c14ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 --2- 172.21.15.81:0/1510420441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c0cc1c0 0x7fbc6c148400 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 >> 172.21.15.81:0/1510420441 conn(0x7fbc6c06ee50 msgr2=0x7fbc6c0c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 shutdown_connections 2024-09-11T01:12:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:02.473+0000 7fbc70a00640 1 -- 172.21.15.81:0/1510420441 wait complete. 2024-09-11T01:12:02.495 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ee045169', quiesce took 5.0 seconds. Will release after: 23.45 2024-09-11T01:12:13.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:12:13.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:12:25.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 -- 172.21.15.81:0/2214963844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 msgr2=0x7ff390003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 --2- 172.21.15.81:0/2214963844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff390003e20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00bb20 tx=0x7ff390005830 comp rx=0 tx=0).stop 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3ae600640 1 -- 172.21.15.81:0/2214963844 reap_dead start 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 -- 172.21.15.81:0/2214963844 shutdown_connections 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 -- 172.21.15.81:0/2214963844 >> 172.21.15.81:0/2214963844 conn(0x7ff3a80700f0 msgr2=0x7ff3a8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 -- 172.21.15.81:0/2214963844 shutdown_connections 2024-09-11T01:12:26.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.113+0000 7ff3b0600640 1 -- 172.21.15.81:0/2214963844 wait complete. 2024-09-11T01:12:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.115+0000 7ff3b0600640 1 Processor -- start 2024-09-11T01:12:26.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.115+0000 7ff3b0600640 1 -- start start 2024-09-11T01:12:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a80c53c0 0x7ff3a81e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 0x7ff3a814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a80c83a0 con 0x7ff390003a00 2024-09-11T01:12:26.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8158380 con 0x7ff3a80c53c0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3b0600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a806ebd0 con 0x7ff3a81e21f0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55534/0 (socket says 172.21.15.81:55534) 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 -- 172.21.15.81:0/1041011322 learned_addr learned my addr 172.21.15.81:0/1041011322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3ae600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 0x7ff3a814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3ad200640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a80c53c0 0x7ff3a81e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 -- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 msgr2=0x7ff3a814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 0x7ff3a814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 -- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a80c53c0 msgr2=0x7ff3a81e1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a80c53c0 0x7ff3a81e1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3adc00640 1 -- 172.21.15.81:0/1041011322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a81e2670 con 0x7ff390003a00 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.116+0000 7ff3ae600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 0x7ff3a814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3adc00640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00bc40 tx=0x7ff39c00b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c040070 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff39c004270 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c035040 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a81f2670 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.117+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a80c65f0 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.118+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a806f5e0 con 0x7ff390003a00 2024-09-11T01:12:26.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.119+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff39c02f650 con 0x7ff390003a00 2024-09-11T01:12:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.120+0000 7ff3a5600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 0x7ff38807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.120+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff39c0bb380 con 0x7ff390003a00 2024-09-11T01:12:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.120+0000 7ff3ad200640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 0x7ff38807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.121+0000 7ff3ad200640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 0x7ff38807a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff394001860 tx=0x7ff394001cb0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.124+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff3a81e2670 con 0x7ff390003a00 2024-09-11T01:12:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.342+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3a806cae0 con 0x7ff390003a00 2024-09-11T01:12:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.342+0000 7ff3a5600640 1 -- 172.21.15.81:0/1041011322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7ff39c083a70 con 0x7ff390003a00 2024-09-11T01:12:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:12:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:12:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.344+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 msgr2=0x7ff38807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.344+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 0x7ff38807a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff394001860 tx=0x7ff394001cb0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.344+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 msgr2=0x7ff3a81f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.344+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00bc40 tx=0x7ff39c00b770 comp rx=0 tx=0).stop 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 shutdown_connections 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff388077fa0 0x7ff38807a460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a81e21f0 0x7ff3a814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a80c53c0 0x7ff3a81e1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 --2- 172.21.15.81:0/1041011322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff390003a00 0x7ff3a81f2130 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 >> 172.21.15.81:0/1041011322 conn(0x7ff3a80700f0 msgr2=0x7ff3a8073300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 shutdown_connections 2024-09-11T01:12:26.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.345+0000 7ff3b0600640 1 -- 172.21.15.81:0/1041011322 wait complete. 2024-09-11T01:12:26.363 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --set-id ee045169 --release --await' 2024-09-11T01:12:26.363 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --set-id ee045169 --release --await 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 -- 172.21.15.81:0/3738880990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc8005230 msgr2=0x7fabc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 --2- 172.21.15.81:0/3738880990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc8005230 0x7fabc800b9c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c640 tx=0x7fabc8005830 comp rx=0 tx=0).stop 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 -- 172.21.15.81:0/3738880990 shutdown_connections 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 --2- 172.21.15.81:0/3738880990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc8005230 0x7fabc800b9c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 -- 172.21.15.81:0/3738880990 >> 172.21.15.81:0/3738880990 conn(0x7fabe406ff90 msgr2=0x7fabe40703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 -- 172.21.15.81:0/3738880990 shutdown_connections 2024-09-11T01:12:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.527+0000 7fabea000640 1 -- 172.21.15.81:0/3738880990 wait complete. 2024-09-11T01:12:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.528+0000 7fabea000640 1 Processor -- start 2024-09-11T01:12:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 -- start start 2024-09-11T01:12:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabc8005230 0x7fabe41f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe414c3c0 0x7fabe414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe40c0eb0 con 0x7fabe4148c30 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4157f40 con 0x7fabe414c3c0 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.529+0000 7fabea000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabe41519a0 con 0x7fabc8005230 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55558/0 (socket says 172.21.15.81:55558) 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 -- 172.21.15.81:0/3883933675 learned_addr learned my addr 172.21.15.81:0/3883933675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe3400640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabc8005230 0x7fabe41f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe3e00640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe414c3c0 0x7fabe414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 -- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabc8005230 msgr2=0x7fabe41f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabc8005230 0x7fabe41f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 -- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe414c3c0 msgr2=0x7fabe414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe414c3c0 0x7fabe414c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 -- 172.21.15.81:0/3883933675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe41f2a30 con 0x7fabe4148c30 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabd00118d0 tx=0x7fabd0011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.530+0000 7fabdb400640 1 -- 172.21.15.81:0/3883933675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd001e070 con 0x7fabe4148c30 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.531+0000 7fabdb400640 1 -- 172.21.15.81:0/3883933675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabd0004460 con 0x7fabe4148c30 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.531+0000 7fabdb400640 1 -- 172.21.15.81:0/3883933675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd000fba0 con 0x7fabe4148c30 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.531+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe414bb00 con 0x7fabe4148c30 2024-09-11T01:12:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.531+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe414c0c0 con 0x7fabe4148c30 2024-09-11T01:12:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.533+0000 7fabdb400640 1 -- 172.21.15.81:0/3883933675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fabd00035f0 con 0x7fabe4148c30 2024-09-11T01:12:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.534+0000 7fabdb400640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 0x7fabc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.534+0000 7fabdb400640 1 -- 172.21.15.81:0/3883933675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fabd009ae00 con 0x7fabe4148c30 2024-09-11T01:12:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.534+0000 7fabece9b740 1 Processor -- start 2024-09-11T01:12:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.534+0000 7fabece9b740 1 -- start start 2024-09-11T01:12:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.534+0000 7fabe3400640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 0x7fabc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da15c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da02390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56293d93f370 con 0x56293d9c7910 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56293d92e7a0 con 0x56293da0c810 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x56293d9325b0 con 0x56293d9cab80 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe3400640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 0x7fabc407a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabd4006da0 tx=0x7fabd4006270 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da15c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55570/0 (socket says 172.21.15.81:55570) 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe3e00640 1 -- 172.21.15.81:0/3605286186 learned_addr learned my addr 172.21.15.81:0/3605286186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.535+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da02390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 -- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 msgr2=0x56293da15c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da15c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 -- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 msgr2=0x56293da02390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da02390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 -- 172.21.15.81:0/3605286186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293d8c7010 con 0x56293d9c7910 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabe3e00640 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c760 tx=0x7fabe406e1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38af81e632353d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabcf400640 1 -- 172.21.15.81:0/3605286186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc039040 con 0x56293d9c7910 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabcf400640 1 -- 172.21.15.81:0/3605286186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabdc02f030 con 0x56293d9c7910 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.536+0000 7fabcf400640 1 -- 172.21.15.81:0/3605286186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc003bd0 con 0x56293d9c7910 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 -- 172.21.15.81:0/3605286186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 msgr2=0x56293da028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c760 tx=0x7fabe406e1c0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 -- 172.21.15.81:0/3605286186 shutdown_connections 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293d9c7910 0x56293da028d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da02390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 --2- 172.21.15.81:0/3605286186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da15c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 -- 172.21.15.81:0/3605286186 >> 172.21.15.81:0/3605286186 conn(0x56293d9c8d60 msgr2=0x56293d9ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 -- 172.21.15.81:0/3605286186 shutdown_connections 2024-09-11T01:12:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.537+0000 7fabece9b740 1 -- 172.21.15.81:0/3605286186 wait complete. 2024-09-11T01:12:26.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.538+0000 7fabece9b740 1 -- start start 2024-09-11T01:12:26.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.538+0000 7fabece9b740 1 Processor -- start 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da14ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56293d8d5f70 con 0x56293da0c810 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56293d8d4090 con 0x56293d9cab80 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x56293da0e970 con 0x56293da109a0 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabece9b740 10 client.0 _ll_register_callbacks cb 0x56293d63d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55572/0 (socket says 172.21.15.81:55572) 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 -- 172.21.15.81:0/3482744468 learned_addr learned my addr 172.21.15.81:0/3482744468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe3400640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe3e00640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da14ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 -- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 msgr2=0x56293da14ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da14ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 -- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 msgr2=0x56293da1fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.539+0000 7fabe2a00640 1 -- 172.21.15.81:0/3482744468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293d690ea0 con 0x56293da0c810 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabe2a00640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabd0000c00 tx=0x7fabd0062910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4b9ae01e1d6e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd006c2f0 con 0x56293da0c810 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fabd004e170 con 0x56293da0c810 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabdc02f030 con 0x56293da0c810 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fabd004e370 con 0x56293da0c810 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 10 client.5991 fetch_fsmap learned FSMap version 9 2024-09-11T01:12:26.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56293d709d30 con 0x56293da0c810 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabdc02f030 con 0x56293da0c810 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fabd0062100 con 0x56293da0c810 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 10 client.5991 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 10 client.5991 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 20 client.5991 populate_metadata read hostname 'smithi081' 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.540+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da1c610 0x56293da1ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.541+0000 7fabece9b740 4 client.5991 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.541+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56293d9412c0 con 0x56293da1c610 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.541+0000 7fabe3400640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da1c610 0x56293da1ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.541+0000 7fabe3400640 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da1c610 0x56293da1ca10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584019084f57f714 server_cookie=e45ebf657f58003a in_seq=0 out_seq=0 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.541+0000 7fabc3e00640 10 client.5991 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.542+0000 7fabc3e00640 1 -- 172.21.15.81:0/3482744468 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56293d9412c0 con 0x56293da1c610 2024-09-11T01:12:26.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.542+0000 7fabc3e00640 10 client.5991 handle_command_reply: tid=0 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.542+0000 7fabece9b740 1 client.5991 shutdown 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 msgr2=0x56293da145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabd0000c00 tx=0x7fabd0062910 comp rx=0 tx=0).stop 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 shutdown_connections 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da1c610 0x56293da1ca10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da14ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da145a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabc3e00640 0 client.5991 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 --2- 172.21.15.81:0/3482744468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 >> 172.21.15.81:0/3482744468 conn(0x56293d9c7910 msgr2=0x56293d9ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 shutdown_connections 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 1 -- 172.21.15.81:0/3482744468 wait complete. 2024-09-11T01:12:26.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.543+0000 7fabece9b740 20 client.5991 trim_cache size 0 max 16384 2024-09-11T01:12:26.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.560+0000 7fabece9b740 1 Processor -- start 2024-09-11T01:12:26.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 -- start start 2024-09-11T01:12:26.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da19d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41fd730 con 0x56293da0c810 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41fc610 con 0x56293d9cab80 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.561+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabe41fac60 con 0x56293da109a0 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55576/0 (socket says 172.21.15.81:55576) 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 -- 172.21.15.81:0/1238823905 learned_addr learned my addr 172.21.15.81:0/1238823905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 -- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 msgr2=0x56293da19d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe3e00640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da19d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe3400640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da19d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 -- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 msgr2=0x56293da1cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 -- 172.21.15.81:0/1238823905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293d9fddd0 con 0x56293da0c810 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe3e00640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da19d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe3400640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabe2a00640 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fabd000f790 tx=0x7fabd0062d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7f8133a5fb1012 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabcea00640 1 -- 172.21.15.81:0/1238823905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0098e60 con 0x56293da0c810 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabcea00640 1 -- 172.21.15.81:0/1238823905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabd006c2f0 con 0x56293da0c810 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.562+0000 7fabcea00640 1 -- 172.21.15.81:0/1238823905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0062100 con 0x56293da0c810 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 -- 172.21.15.81:0/1238823905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 msgr2=0x56293da19840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fabd000f790 tx=0x7fabd0062d30 comp rx=0 tx=0).stop 2024-09-11T01:12:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 -- 172.21.15.81:0/1238823905 shutdown_connections 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293da109a0 0x56293da19d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da0c810 0x56293da19840 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 --2- 172.21.15.81:0/1238823905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293d9cab80 0x56293da1cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 -- 172.21.15.81:0/1238823905 >> 172.21.15.81:0/1238823905 conn(0x56293d9c7910 msgr2=0x56293d9c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 -- 172.21.15.81:0/1238823905 shutdown_connections 2024-09-11T01:12:26.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.563+0000 7fabece9b740 1 -- 172.21.15.81:0/1238823905 wait complete. 2024-09-11T01:12:26.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.564+0000 7fabece9b740 1 -- start start 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.564+0000 7fabece9b740 1 Processor -- start 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da923e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da8ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41fb280 con 0x56293da109a0 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41fbf40 con 0x56293da0c810 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabe41fb8d0 con 0x56293d9cab80 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabece9b740 10 client.0 _ll_register_callbacks cb 0x7fabd4006110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55584/0 (socket says 172.21.15.81:55584) 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabe3e00640 1 -- 172.21.15.81:0/792901632 learned_addr learned my addr 172.21.15.81:0/792901632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:26.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabe2a00640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da8ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.565+0000 7fabe3400640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 -- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 msgr2=0x56293da923e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da923e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 -- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 msgr2=0x56293da8ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da8ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 -- 172.21.15.81:0/792901632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293da95060 con 0x56293da109a0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabe3e00640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fabdc02b360 tx=0x7fabdc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c78c6e9a8b4b381 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabc3e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc04c060 con 0x56293da109a0 2024-09-11T01:12:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fabdc00c2c0 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabd006c2f0 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fabdc052050 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabece9b740 10 client.5997 fetch_fsmap learned FSMap version 9 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.566+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56293da26700 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabd006c2f0 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fabdc055020 con 0x56293da109a0 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 10 client.5997 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 10 client.5997 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 20 client.5997 populate_metadata read hostname 'smithi081' 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da8bf40 0x56293da19d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 4 client.5997 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ee045169", "release": true, "await": true}] 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ee045169", "release": true, "await": true}) -- 0x56293d93cd70 con 0x56293da8bf40 2024-09-11T01:12:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.567+0000 7fabe3400640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da8bf40 0x56293da19d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.568+0000 7fabe3400640 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da8bf40 0x56293da19d80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a625e8356cef601 server_cookie=1ef7e91bcff31783 in_seq=0 out_seq=0 2024-09-11T01:12:26.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.568+0000 7fabc3e00640 10 client.5997 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.585+0000 7fabc3e00640 1 -- 172.21.15.81:0/792901632 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56293d93cd70 con 0x56293da8bf40 2024-09-11T01:12:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.585+0000 7fabc3e00640 10 client.5997 handle_command_reply: tid=0 2024-09-11T01:12:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.585+0000 7fabece9b740 1 client.5997 shutdown 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.585+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 msgr2=0x56293da19840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.585+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fabdc02b360 tx=0x7fabdc003d50 comp rx=0 tx=0).stop 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 shutdown_connections 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x56293da8bf40 0x56293da19d80 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293da109a0 0x56293da19840 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56293da0c810 0x56293da8ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 --2- 172.21.15.81:0/792901632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56293d9cab80 0x56293da923e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabc3e00640 0 client.5997 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 >> 172.21.15.81:0/792901632 conn(0x56293d9c7910 msgr2=0x56293d9c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 shutdown_connections 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 1 -- 172.21.15.81:0/792901632 wait complete. 2024-09-11T01:12:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabece9b740 20 client.5997 trim_cache size 0 max 16384 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 92, 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "ee045169": { 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 92, 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:12:26.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 148.4, 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 msgr2=0x7fabc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 0x7fabc407a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabd4006da0 tx=0x7fabd4006270 comp rx=0 tx=0).stop 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 msgr2=0x7fabe41eee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.586+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabd00118d0 tx=0x7fabd0011d90 comp rx=0 tx=0).stop 2024-09-11T01:12:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 shutdown_connections 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fabc4077f70 0x7fabc407a430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe414c3c0 0x7fabe414c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe4148c30 0x7fabe41eee10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 --2- 172.21.15.81:0/3883933675 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabc8005230 0x7fabe41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 >> 172.21.15.81:0/3883933675 conn(0x7fabe406ff90 msgr2=0x7fabe41565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 shutdown_connections 2024-09-11T01:12:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:26.587+0000 7fabea000640 1 -- 172.21.15.81:0/3883933675 wait complete. 2024-09-11T01:12:26.604 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ee045169', total seconds elapsed: 29.1 2024-09-11T01:12:28.279 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T01:12:28.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T01:12:28.346 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-11T01:12:28.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T01:12:29.570 DEBUG:teuthology.parallel:result is None 2024-09-11T01:12:29.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T01:12:29.764 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T01:12:29.764 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-11T01:12:30.394 INFO:tasks.quiescer:joining Quiescers 2024-09-11T01:12:30.394 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-11T01:12:30.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 -- 172.21.15.81:0/3485381453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54800c8680 msgr2=0x7f54800c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 --2- 172.21.15.81:0/3485381453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54800c8680 0x7f54800c7ec0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f548006ec00 tx=0x7f547802a5c0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 -- 172.21.15.81:0/3485381453 shutdown_connections 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 --2- 172.21.15.81:0/3485381453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54800c8680 0x7f54800c7ec0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 --2- 172.21.15.81:0/3485381453 >> v2:172.21.15.167:3300/0 conn(0x7f5480074860 0x7f54800c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 -- 172.21.15.81:0/3485381453 >> 172.21.15.81:0/3485381453 conn(0x7f54800700f0 msgr2=0x7f5480070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 -- 172.21.15.81:0/3485381453 shutdown_connections 2024-09-11T01:12:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.550+0000 7f5486400640 1 -- 172.21.15.81:0/3485381453 wait complete. 2024-09-11T01:12:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.552+0000 7f5486400640 1 Processor -- start 2024-09-11T01:12:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.552+0000 7f5486400640 1 -- start start 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480074860 0x7f54800cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f548015b6a0 0x7f548013f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5480070cf0 con 0x7f5480152610 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f548015c140 con 0x7f5480074860 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f5486400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f54800c16a0 con 0x7f548015b6a0 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55608/0 (socket says 172.21.15.81:55608) 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 -- 172.21.15.81:0/3697570592 learned_addr learned my addr 172.21.15.81:0/3697570592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547f400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480074860 0x7f54800cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547fe00640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f548015b6a0 0x7f548013f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 -- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f548015b6a0 msgr2=0x7f548013f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f548015b6a0 0x7f548013f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 -- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480074860 msgr2=0x7f54800cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480074860 0x7f54800cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.553+0000 7f547ea00640 1 -- 172.21.15.81:0/3697570592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54800ca100 con 0x7f5480152610 2024-09-11T01:12:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f547ea00640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c950 tx=0x7f546c00ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c007c70 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f546c00f450 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c00f8a0 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54800ca3a0 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.554+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548015aea0 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.555+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54800ca880 con 0x7f5480152610 2024-09-11T01:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.556+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f546c020030 con 0x7f5480152610 2024-09-11T01:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.557+0000 7f5477400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 0x7f546007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.557+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f546c09a740 con 0x7f5480152610 2024-09-11T01:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.557+0000 7f547f400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 0x7f546007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.558+0000 7f547f400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 0x7f546007a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5480074fb0 tx=0x7f5470009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.561+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f54800ca880 con 0x7f5480152610 2024-09-11T01:12:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.780+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54801529f0 con 0x7f5480152610 2024-09-11T01:12:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.781+0000 7f5477400640 1 -- 172.21.15.81:0/3697570592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f546c014030 con 0x7f5480152610 2024-09-11T01:12:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:30.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:12:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:12:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 msgr2=0x7f546007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 0x7f546007a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5480074fb0 tx=0x7f5470009040 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 msgr2=0x7f5480146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c950 tx=0x7f546c00ce10 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 shutdown_connections 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f5460077f70 0x7f546007a430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f548015b6a0 0x7f548013f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5480152610 0x7f5480146510 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 --2- 172.21.15.81:0/3697570592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480074860 0x7f54800cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 >> 172.21.15.81:0/3697570592 conn(0x7f54800700f0 msgr2=0x7f54800c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 shutdown_connections 2024-09-11T01:12:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.783+0000 7f5486400640 1 -- 172.21.15.81:0/3697570592 wait complete. 2024-09-11T01:12:30.800 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4411 quiesce db --cancel --all' 2024-09-11T01:12:30.800 DEBUG:teuthology.orchestra.run.smithi081:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4411 quiesce db --cancel --all 2024-09-11T01:12:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 -- 172.21.15.81:0/323683360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 msgr2=0x7f70d406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 --2- 172.21.15.81:0/323683360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d406e750 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f70d4069c20 tx=0x7f70cc02aae0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 -- 172.21.15.81:0/323683360 shutdown_connections 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 --2- 172.21.15.81:0/323683360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d406e750 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 --2- 172.21.15.81:0/323683360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 --2- 172.21.15.81:0/323683360 >> v2:172.21.15.167:3300/0 conn(0x7f70d4152880 0x7f70d40725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 -- 172.21.15.81:0/323683360 >> 172.21.15.81:0/323683360 conn(0x7f70d406ffb0 msgr2=0x7f70d40703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 -- 172.21.15.81:0/323683360 shutdown_connections 2024-09-11T01:12:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.963+0000 7f70da200640 1 -- 172.21.15.81:0/323683360 wait complete. 2024-09-11T01:12:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.964+0000 7f70da200640 1 Processor -- start 2024-09-11T01:12:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 -- start start 2024-09-11T01:12:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 0x7f70d414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d4156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70d40c7dd0 con 0x7f70d415c650 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41590f0 con 0x7f70d4152880 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.965+0000 7f70da200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f70d40c7f50 con 0x7f70d4070b80 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d4156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 0x7f70d414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d4159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.81:38360/0 (socket says 172.21.15.81:38360) 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3400640 1 -- 172.21.15.81:0/2903668737 learned_addr learned my addr 172.21.15.81:0/2903668737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 -- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 msgr2=0x7f70d4159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d4159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 -- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 msgr2=0x7f70d414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 0x7f70d414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 -- 172.21.15.81:0/2903668737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d414b090 con 0x7f70d415c650 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d2a00640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 0x7f70d414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.966+0000 7f70d3e00640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d4156340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f70cc032000 tx=0x7f70cc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.967+0000 7f70cb400640 1 -- 172.21.15.81:0/2903668737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc044070 con 0x7f70d415c650 2024-09-11T01:12:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.967+0000 7f70cb400640 1 -- 172.21.15.81:0/2903668737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70cc004250 con 0x7f70d415c650 2024-09-11T01:12:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.967+0000 7f70cb400640 1 -- 172.21.15.81:0/2903668737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0046a0 con 0x7f70d415c650 2024-09-11T01:12:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.967+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d40c1240 con 0x7f70d415c650 2024-09-11T01:12:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.967+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d41f0940 con 0x7f70d415c650 2024-09-11T01:12:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.969+0000 7f70cb400640 1 -- 172.21.15.81:0/2903668737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f70cc0300d0 con 0x7f70d415c650 2024-09-11T01:12:30.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.971+0000 7f70cb400640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 0x7f70b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.971+0000 7f70cb400640 1 -- 172.21.15.81:0/2903668737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f70cc0bb150 con 0x7f70d415c650 2024-09-11T01:12:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.971+0000 7f70dd263740 1 Processor -- start 2024-09-11T01:12:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.971+0000 7f70d3400640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 0x7f70b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.971+0000 7f70dd263740 1 -- start start 2024-09-11T01:12:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70d3400640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 0x7f70b407a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70c4005fd0 tx=0x7f70c400b480 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 0x557c566dd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557c5661a780 con 0x557c566a6460 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c56609bb0 con 0x557c566a2500 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557c5660d9c0 con 0x557c566a85e0 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55636/0 (socket says 172.21.15.81:55636) 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.972+0000 7f70d2a00640 1 -- 172.21.15.81:0/1954268135 learned_addr learned my addr 172.21.15.81:0/1954268135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d3e00640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 0x557c566dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d3400640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 -- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 msgr2=0x557c566a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 -- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 msgr2=0x557c566dd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 0x557c566dd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 -- 172.21.15.81:0/1954268135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c56597cf0 con 0x557c566a6460 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d3e00640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 0x557c566dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d3400640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70d2a00640 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70c000bf70 tx=0x7f70c0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9323f31d6dcec180 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70bf400640 1 -- 172.21.15.81:0/1954268135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011700 con 0x557c566a6460 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70bf400640 1 -- 172.21.15.81:0/1954268135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70c0011990 con 0x557c566a6460 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.973+0000 7f70bf400640 1 -- 172.21.15.81:0/1954268135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011d60 con 0x557c566a6460 2024-09-11T01:12:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 -- 172.21.15.81:0/1954268135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 msgr2=0x557c566a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70c000bf70 tx=0x7f70c0010860 comp rx=0 tx=0).stop 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 -- 172.21.15.81:0/1954268135 shutdown_connections 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566a2500 0x557c566dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566a6460 0x557c566a1fc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 --2- 172.21.15.81:0/1954268135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 -- 172.21.15.81:0/1954268135 >> 172.21.15.81:0/1954268135 conn(0x557c566a3850 msgr2=0x557c566a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 -- 172.21.15.81:0/1954268135 shutdown_connections 2024-09-11T01:12:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.974+0000 7f70dd263740 1 -- 172.21.15.81:0/1954268135 wait complete. 2024-09-11T01:12:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.975+0000 7f70dd263740 1 -- start start 2024-09-11T01:12:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.975+0000 7f70dd263740 1 Processor -- start 2024-09-11T01:12:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557c5637a960 con 0x557c566d1980 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c565af650 con 0x557c566d8160 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557c566a2960 con 0x557c566a85e0 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70dd263740 10 client.0 _ll_register_callbacks cb 0x557c565b5820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55642/0 (socket says 172.21.15.81:55642) 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 -- 172.21.15.81:0/3687683637 learned_addr learned my addr 172.21.15.81:0/3687683637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d3e00640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d3400640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 -- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 msgr2=0x557c566dbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566dbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 -- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 msgr2=0x557c566cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.976+0000 7f70d2a00640 1 -- 172.21.15.81:0/3687683637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c563e4a20 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70d2a00640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70c0010d60 tx=0x7f70c0011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dca25c70de11c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0005020 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f70c00051c0 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70c0011990 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f70c002f050 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70dd263740 10 client.6018 fetch_fsmap learned FSMap version 9 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.977+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557c564451b0 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70c0011990 con 0x557c566d1980 2024-09-11T01:12:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f70c0032020 con 0x557c566d1980 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 10 client.6018 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 10 client.6018 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 20 client.6018 populate_metadata read hostname 'smithi081' 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566d8540 0x557c566fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 4 client.6018 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5661c6d0 con 0x557c566d8540 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.978+0000 7f70d3400640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566d8540 0x557c566fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.979+0000 7f70d3400640 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566d8540 0x557c566fb6d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64829540e020d57c server_cookie=327bfb1c0956a12d in_seq=0 out_seq=0 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.979+0000 7f70b3e00640 10 client.6018 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70b3e00640 1 -- 172.21.15.81:0/3687683637 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c5661c6d0 con 0x557c566d8540 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70b3e00640 10 client.6018 handle_command_reply: tid=0 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 client.6018 shutdown 2024-09-11T01:12:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 msgr2=0x557c566da0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70c0010d60 tx=0x7f70c0011730 comp rx=0 tx=0).stop 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 shutdown_connections 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566d8540 0x557c566fb6d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566da0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 --2- 172.21.15.81:0/3687683637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566dbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 >> 172.21.15.81:0/3687683637 conn(0x557c566a2500 msgr2=0x557c566a5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70b3e00640 0 client.6018 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 shutdown_connections 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.980+0000 7f70dd263740 1 -- 172.21.15.81:0/3687683637 wait complete. 2024-09-11T01:12:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:30.981+0000 7f70dd263740 20 client.6018 trim_cache size 0 max 16384 2024-09-11T01:12:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.000+0000 7f70dd263740 1 Processor -- start 2024-09-11T01:12:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.000+0000 7f70dd263740 1 -- start start 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566d7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d1980 0x557c566a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41ff4d0 con 0x557c566d8160 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41fe3b0 con 0x557c566d1980 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f70d41e3910 con 0x557c566a85e0 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55654/0 (socket says 172.21.15.81:55654) 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70d3e00640 1 -- 172.21.15.81:0/857919077 learned_addr learned my addr 172.21.15.81:0/857919077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70d3400640 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566d7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.001+0000 7f70d2a00640 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d1980 0x557c566a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 -- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 msgr2=0x557c566d7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566d7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 -- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d1980 msgr2=0x557c566a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d1980 0x557c566a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 -- 172.21.15.81:0/857919077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c563498c0 con 0x557c566d8160 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70d3e00640 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70cc083180 tx=0x7f70cc08c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e57d85cb91c82a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70bea00640 1 -- 172.21.15.81:0/857919077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0098d0 con 0x557c566d8160 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70bea00640 1 -- 172.21.15.81:0/857919077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70cc082d00 con 0x557c566d8160 2024-09-11T01:12:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.002+0000 7f70bea00640 1 -- 172.21.15.81:0/857919077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0831f0 con 0x557c566d8160 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 -- 172.21.15.81:0/857919077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 msgr2=0x557c566a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70cc083180 tx=0x7f70cc08c0d0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 -- 172.21.15.81:0/857919077 shutdown_connections 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d8160 0x557c566a7290 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d1980 0x557c566a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 --2- 172.21.15.81:0/857919077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566d7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 -- 172.21.15.81:0/857919077 >> 172.21.15.81:0/857919077 conn(0x557c566a2500 msgr2=0x557c566cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 -- 172.21.15.81:0/857919077 shutdown_connections 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.003+0000 7f70dd263740 1 -- 172.21.15.81:0/857919077 wait complete. 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.004+0000 7f70dd263740 1 -- start start 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.004+0000 7f70dd263740 1 Processor -- start 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41fd030 con 0x557c566d1980 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41fdce0 con 0x557c566d8160 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f70d41fd650 con 0x557c566a85e0 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70dd263740 10 client.0 _ll_register_callbacks cb 0x7f70c000bc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55670/0 (socket says 172.21.15.81:55670) 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 -- 172.21.15.81:0/2276802080 learned_addr learned my addr 172.21.15.81:0/2276802080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d3400640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d3e00640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 -- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 msgr2=0x557c566a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 -- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 msgr2=0x557c566a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.005+0000 7f70d2a00640 1 -- 172.21.15.81:0/2276802080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c565d6850 con 0x557c566d1980 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70d2a00640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f70c0010d60 tx=0x7f70c0010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35339db14a9e23ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0026480 con 0x557c566d1980 2024-09-11T01:12:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f70c0026620 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70cc082d00 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f70c0026820 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 10 client.6024 fetch_fsmap learned FSMap version 9 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557c566f00c0 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70cc082d00 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f70c0042020 con 0x557c566d1980 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 10 client.6024 fetch_fsmap finished waiting for FSMap version 9 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 10 client.6024 resolve_mds: validated gid 4411 aka daemon mds.b 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 20 client.6024 populate_metadata read hostname 'smithi081' 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566a5460 0x557c566a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 4 client.6024 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.006+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 --> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x557c56618180 con 0x557c566a5460 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.007+0000 7f70d3400640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566a5460 0x557c566a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.007+0000 7f70d3400640 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566a5460 0x557c566a5840 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e224649f7e066eb5 server_cookie=9fafc5531acb33fb in_seq=0 out_seq=0 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.007+0000 7f70b3e00640 10 client.6024 ms_handle_connect on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70b3e00640 1 -- 172.21.15.81:0/2276802080 <== mds.0 v2:172.21.15.167:6834/1821136348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x557c56618180 con 0x557c566a5460 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70b3e00640 10 client.6024 handle_command_reply: tid=0 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 client.6024 shutdown 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 msgr2=0x557c566a09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f70c0010d60 tx=0x7f70c0010e80 comp rx=0 tx=0).stop 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 shutdown_connections 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:6834/1821136348,v1:172.21.15.167:6835/1821136348] conn(0x557c566a5460 0x557c566a5840 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c566d8160 0x557c566a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557c566d1980 0x557c566a09f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70b3e00640 0 client.6024 ms_handle_reset on v2:172.21.15.167:6834/1821136348 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 --2- 172.21.15.81:0/2276802080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c566a85e0 0x557c566a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 >> 172.21.15.81:0/2276802080 conn(0x557c566a2500 msgr2=0x557c566d7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 shutdown_connections 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 1 -- 172.21.15.81:0/2276802080 wait complete. 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.008+0000 7f70dd263740 20 client.6024 trim_cache size 0 max 16384 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 9, 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 4411, 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 92, 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": {} 2024-09-11T01:12:31.015 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:31.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 msgr2=0x7f70b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 0x7f70b407a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70c4005fd0 tx=0x7f70c400b480 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 msgr2=0x7f70d4156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d4156340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f70cc032000 tx=0x7f70cc003d00 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 shutdown_connections 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f70b4077f70 0x7f70b407a430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d415c650 0x7f70d4156340 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d4152880 0x7f70d414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 --2- 172.21.15.81:0/2903668737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d4070b80 0x7f70d4159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 >> 172.21.15.81:0/2903668737 conn(0x7f70d406ffb0 msgr2=0x7f70d406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 shutdown_connections 2024-09-11T01:12:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.009+0000 7f70da200640 1 -- 172.21.15.81:0/2903668737 wait complete. 2024-09-11T01:12:31.026 INFO:tasks.quiescer:done joining Quiescers 2024-09-11T01:12:31.026 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T01:12:31.035 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T01:12:31.035 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T01:12:31.035 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:12:31.079 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T01:12:31.079 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:12:31.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 -- 172.21.15.81:0/996669638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 msgr2=0x7fd11006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 --2- 172.21.15.81:0/996669638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11006d450 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd1100769b0 tx=0x7fd10002a560 comp rx=0 tx=0).stop 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 -- 172.21.15.81:0/996669638 shutdown_connections 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 --2- 172.21.15.81:0/996669638 >> v2:172.21.15.167:3300/0 conn(0x7fd110074b30 0x7fd11015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 --2- 172.21.15.81:0/996669638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1100b1f10 0x7fd1100745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 --2- 172.21.15.81:0/996669638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11006d450 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 -- 172.21.15.81:0/996669638 >> 172.21.15.81:0/996669638 conn(0x7fd11006ffd0 msgr2=0x7fd1100703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 -- 172.21.15.81:0/996669638 shutdown_connections 2024-09-11T01:12:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.351+0000 7fd116400640 1 -- 172.21.15.81:0/996669638 wait complete. 2024-09-11T01:12:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.353+0000 7fd116400640 1 Processor -- start 2024-09-11T01:12:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.353+0000 7fd116400640 1 -- start start 2024-09-11T01:12:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd110074b30 0x7fd1101f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1100b1f10 0x7fd11014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1100c7040 con 0x7fd11014ebc0 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd1101581a0 con 0x7fd1100b1f10 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd116400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd11014efa0 con 0x7fd110074b30 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55686/0 (socket says 172.21.15.81:55686) 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 -- 172.21.15.81:0/2549904505 learned_addr learned my addr 172.21.15.81:0/2549904505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115000640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd110074b30 0x7fd1101f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd107e00640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1100b1f10 0x7fd11014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 -- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd110074b30 msgr2=0x7fd1101f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd110074b30 0x7fd1101f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 -- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1100b1f10 msgr2=0x7fd11014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1100b1f10 0x7fd11014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.354+0000 7fd115a00640 1 -- 172.21.15.81:0/2549904505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd110072c20 con 0x7fd11014ebc0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd115a00640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd10800eb40 tx=0x7fd10800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108004b20 con 0x7fd11014ebc0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd108004ce0 con 0x7fd11014ebc0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1101f1220 con 0x7fd11014ebc0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108005280 con 0x7fd11014ebc0 2024-09-11T01:12:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.355+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1101f0460 con 0x7fd11014ebc0 2024-09-11T01:12:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.356+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1100745f0 con 0x7fd11014ebc0 2024-09-11T01:12:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.357+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd108005420 con 0x7fd11014ebc0 2024-09-11T01:12:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.358+0000 7fd10d600640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 0x7fd0ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.358+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd10809adc0 con 0x7fd11014ebc0 2024-09-11T01:12:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.359+0000 7fd115000640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 0x7fd0ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.360+0000 7fd115000640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 0x7fd0ec07a430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd100033000 tx=0x7fd100004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.363+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd108062e60 con 0x7fd11014ebc0 2024-09-11T01:12:31.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.559+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1100c72b0 con 0x7fd11014ebc0 2024-09-11T01:12:31.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.559+0000 7fd10d600640 1 -- 172.21.15.81:0/2549904505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fd108067890 con 0x7fd11014ebc0 2024-09-11T01:12:31.561 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-11T01:12:31.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 msgr2=0x7fd0ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 0x7fd0ec07a430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd100033000 tx=0x7fd100004730 comp rx=0 tx=0).stop 2024-09-11T01:12:31.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 msgr2=0x7fd11014dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd10800eb40 tx=0x7fd10800c2d0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 shutdown_connections 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd0ec077f70 0x7fd0ec07a430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11014ebc0 0x7fd11014dd10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1100b1f10 0x7fd11014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 --2- 172.21.15.81:0/2549904505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd110074b30 0x7fd1101f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.561+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 >> 172.21.15.81:0/2549904505 conn(0x7fd11006ffd0 msgr2=0x7fd1100b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.562+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 shutdown_connections 2024-09-11T01:12:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.562+0000 7fd116400640 1 -- 172.21.15.81:0/2549904505 wait complete. 2024-09-11T01:12:31.578 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-11T01:12:31.579 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:12:31.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 -- 172.21.15.81:0/587490258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c003a30 msgr2=0x7f789c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 --2- 172.21.15.81:0/587490258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c003a30 0x7f789c003e50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f78a8001d90 tx=0x7f789c005830 comp rx=0 tx=0).stop 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78b7e00640 1 -- 172.21.15.81:0/587490258 reap_dead start 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 -- 172.21.15.81:0/587490258 shutdown_connections 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 -- 172.21.15.81:0/587490258 >> 172.21.15.81:0/587490258 conn(0x7f78b80700f0 msgr2=0x7f78b8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 -- 172.21.15.81:0/587490258 shutdown_connections 2024-09-11T01:12:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.812+0000 7f78be600640 1 -- 172.21.15.81:0/587490258 wait complete. 2024-09-11T01:12:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.814+0000 7f78be600640 1 Processor -- start 2024-09-11T01:12:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.814+0000 7f78be600640 1 -- start start 2024-09-11T01:12:31.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f789c003a30 0x7f78b8155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78b8153a10 0x7f78b8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78b8070cf0 con 0x7f78b806d0d0 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f78b815c140 con 0x7f789c003a30 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78be600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f78b80c16a0 con 0x7f78b8153a10 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55698/0 (socket says 172.21.15.81:55698) 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 -- 172.21.15.81:0/1793682414 learned_addr learned my addr 172.21.15.81:0/1793682414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 -- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78b8153a10 msgr2=0x7f78b8157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78b8153a10 0x7f78b8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 -- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f789c003a30 msgr2=0x7f78b8155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f789c003a30 0x7f78b8155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 -- 172.21.15.81:0/1793682414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b8158790 con 0x7f78b806d0d0 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.815+0000 7f78b7e00640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f78b80711b0 tx=0x7f78b0011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.816+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b000fd90 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.816+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b0004020 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.816+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0004470 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.816+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b81f1f20 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.816+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b8158e20 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.817+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b80c8680 con 0x7f78b806d0d0 2024-09-11T01:12:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.818+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78b00035f0 con 0x7f78b806d0d0 2024-09-11T01:12:31.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.819+0000 7f78af400640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 0x7f789807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:31.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.819+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f78b009a9a0 con 0x7f78b806d0d0 2024-09-11T01:12:31.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.819+0000 7f78b7400640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 0x7f789807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:31.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.820+0000 7f78b7400640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 0x7f789807a460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78a8032000 tx=0x7f78a80014e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:31.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:31.823+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78b0011e20 con 0x7f78b806d0d0 2024-09-11T01:12:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.021+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f78b80c2a70 con 0x7f78b806d0d0 2024-09-11T01:12:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.021+0000 7f78af400640 1 -- 172.21.15.81:0/1793682414 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f78b00631c0 con 0x7f78b806d0d0 2024-09-11T01:12:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-11T01:12:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.023+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 msgr2=0x7f789807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.023+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 0x7f789807a460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78a8032000 tx=0x7f78a80014e0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.023+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 msgr2=0x7f78b8146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.023+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f78b80711b0 tx=0x7f78b0011bd0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 shutdown_connections 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7898077fa0 0x7f789807a460 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78b806d0d0 0x7f78b8146980 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f78b8153a10 0x7f78b8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 --2- 172.21.15.81:0/1793682414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f789c003a30 0x7f78b8155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 >> 172.21.15.81:0/1793682414 conn(0x7f78b80700f0 msgr2=0x7f78b80c79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 shutdown_connections 2024-09-11T01:12:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:32.024+0000 7f78be600640 1 -- 172.21.15.81:0/1793682414 wait complete. 2024-09-11T01:12:32.041 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-11T01:12:32.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:12:32.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T01:12:32.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:12:32.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45017]: fuse finished with error 0 and tester_r 0 2024-09-11T01:12:38.209 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:12:38.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:12:38.209 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T01:12:38.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:12:38.260 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-11T01:12:38.342 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T01:12:38.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:12:38.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T01:12:38.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:12:38.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-11T01:12:38.696 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T01:12:38.709 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T01:12:38.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:12:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.868+0000 7f3a14800640 1 -- 172.21.15.81:0/1158246003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c0c8680 msgr2=0x7f3a0c163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.868+0000 7f3a14800640 1 --2- 172.21.15.81:0/1158246003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c0c8680 0x7f3a0c163da0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005fd0 tx=0x7f3a0802ab20 comp rx=0 tx=0).stop 2024-09-11T01:12:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.868+0000 7f3a14800640 1 -- 172.21.15.81:0/1158246003 shutdown_connections 2024-09-11T01:12:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.868+0000 7f3a14800640 1 --2- 172.21.15.81:0/1158246003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c0c8680 0x7f3a0c163da0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.868+0000 7f3a14800640 1 -- 172.21.15.81:0/1158246003 >> 172.21.15.81:0/1158246003 conn(0x7f3a0c0700f0 msgr2=0x7f3a0c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.869+0000 7f3a14800640 1 -- 172.21.15.81:0/1158246003 shutdown_connections 2024-09-11T01:12:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.869+0000 7f3a14800640 1 -- 172.21.15.81:0/1158246003 wait complete. 2024-09-11T01:12:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.870+0000 7f3a14800640 1 Processor -- start 2024-09-11T01:12:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.871+0000 7f3a14800640 1 -- start start 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.871+0000 7f3a14800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 0x7f3a0c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.871+0000 7f3a14800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a0c152610 0x7f3a0c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a14800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a14800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c070cf0 con 0x7f3a0c14e620 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a14800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c15c140 con 0x7f3a0c074860 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a14800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0c0c16a0 con 0x7f3a0c152610 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50860/0 (socket says 172.21.15.81:50860) 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 -- 172.21.15.81:0/23855228 learned_addr learned my addr 172.21.15.81:0/23855228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a11400640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a0c152610 0x7f3a0c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a11e00640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 0x7f3a0c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 -- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a0c152610 msgr2=0x7f3a0c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a0c152610 0x7f3a0c159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 -- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 msgr2=0x7f3a0c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 0x7f3a0c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a12800640 1 -- 172.21.15.81:0/23855228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c15b7e0 con 0x7f3a0c14e620 2024-09-11T01:12:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.872+0000 7f3a11e00640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 0x7f3a0c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a12800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009d90 tx=0x7f3a08003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08044070 con 0x7f3a0c14e620 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a08004250 con 0x7f3a0c14e620 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08004660 con 0x7f3a0c14e620 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0c1ee1e0 con 0x7f3a0c14e620 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.873+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0c0c2d80 con 0x7f3a0c14e620 2024-09-11T01:12:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.874+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0c1529f0 con 0x7f3a0c14e620 2024-09-11T01:12:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.875+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3a08036400 con 0x7f3a0c14e620 2024-09-11T01:12:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.877+0000 7f3a06000640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 0x7f39f007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.877+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f3a080baa00 con 0x7f3a0c14e620 2024-09-11T01:12:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.877+0000 7f3a11e00640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 0x7f39f007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.878+0000 7f3a11e00640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 0x7f39f007a460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a00006fd0 tx=0x7f3a00008040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:38.881+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3a08032030 con 0x7f3a0c14e620 2024-09-11T01:12:39.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.065+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a0c0c2ff0 con 0x7f39f0077fa0 2024-09-11T01:12:39.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.073+0000 7f3a06000640 1 -- 172.21.15.81:0/23855228 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334149 (secure 0 0 0) 0x7f3a0c0c2ff0 con 0x7f39f0077fa0 2024-09-11T01:12:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:39.080 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:12:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 msgr2=0x7f39f007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 0x7f39f007a460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a00006fd0 tx=0x7f3a00008040 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 msgr2=0x7f3a0c1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009d90 tx=0x7f3a08003d00 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 shutdown_connections 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f39f0077fa0 0x7f39f007a460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a0c14e620 0x7f3a0c1477f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a0c152610 0x7f3a0c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 --2- 172.21.15.81:0/23855228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a0c074860 0x7f3a0c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 >> 172.21.15.81:0/23855228 conn(0x7f3a0c0700f0 msgr2=0x7f3a0c14fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 shutdown_connections 2024-09-11T01:12:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.078+0000 7f3a14800640 1 -- 172.21.15.81:0/23855228 wait complete. 2024-09-11T01:12:39.098 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":880,"stamp":"2024-09-11T01:12:38.336549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16457816,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617527,"num_write_kb":15568565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122311,"ondisk_log_size":122311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5099712,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5076531,"kb_avail":749875008,"statfs":{"total":773094113280,"available":767872008192,"internally_reserved":0,"allocated":23592960,"data_stored":33909384,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5198368305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1679016204,"num_objects":-600,"num_object_clones":0,"num_object_copies":-2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-600,"num_whiteouts":0,"num_read":6,"num_read_kb":34,"num_write":710,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003776"},"pg_stats":[{"pgid":"2.1f","version":"29'455","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.186156+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T01:12:32.186156+0000","last_peered":"2024-09-11T01:12:32.186156+0000","last_clean":"2024-09-11T01:12:32.186156+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:32.186156+0000","last_undegraded":"2024-09-11T01:12:32.186156+0000","last_fullsized":"2024-09-11T01:12:32.186156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189379,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":3331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180955+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T01:12:32.180955+0000","last_peered":"2024-09-11T01:12:32.180955+0000","last_clean":"2024-09-11T01:12:32.180955+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:32.180955+0000","last_undegraded":"2024-09-11T01:12:32.180955+0000","last_fullsized":"2024-09-11T01:12:32.180955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4034,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.363576+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T01:12:30.363576+0000","last_peered":"2024-09-11T01:12:30.363576+0000","last_clean":"2024-09-11T01:12:30.363576+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:30.363576+0000","last_undegraded":"2024-09-11T01:12:30.363576+0000","last_fullsized":"2024-09-11T01:12:30.363576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256931+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T01:12:30.256931+0000","last_peered":"2024-09-11T01:12:30.256931+0000","last_clean":"2024-09-11T01:12:30.256931+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:30.256931+0000","last_undegraded":"2024-09-11T01:12:30.256931+0000","last_fullsized":"2024-09-11T01:12:30.256931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181533+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T01:12:32.181533+0000","last_peered":"2024-09-11T01:12:32.181533+0000","last_clean":"2024-09-11T01:12:32.181533+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:32.181533+0000","last_undegraded":"2024-09-11T01:12:32.181533+0000","last_fullsized":"2024-09-11T01:12:32.181533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.346355+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T01:12:30.346355+0000","last_peered":"2024-09-11T01:12:30.346355+0000","last_clean":"2024-09-11T01:12:30.346355+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:30.346355+0000","last_undegraded":"2024-09-11T01:12:30.346355+0000","last_fullsized":"2024-09-11T01:12:30.346355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.304546+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T01:12:30.304546+0000","last_peered":"2024-09-11T01:12:30.304546+0000","last_clean":"2024-09-11T01:12:30.304546+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:30.304546+0000","last_undegraded":"2024-09-11T01:12:30.304546+0000","last_fullsized":"2024-09-11T01:12:30.304546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180664+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T01:12:32.180664+0000","last_peered":"2024-09-11T01:12:32.180664+0000","last_clean":"2024-09-11T01:12:32.180664+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:32.180664+0000","last_undegraded":"2024-09-11T01:12:32.180664+0000","last_fullsized":"2024-09-11T01:12:32.180664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3815,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.340870+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T01:12:30.340870+0000","last_peered":"2024-09-11T01:12:30.340870+0000","last_clean":"2024-09-11T01:12:30.340870+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:30.340870+0000","last_undegraded":"2024-09-11T01:12:30.340870+0000","last_fullsized":"2024-09-11T01:12:30.340870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:46.284968+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T01:11:46.284968+0000","last_peered":"2024-09-11T01:11:46.284968+0000","last_clean":"2024-09-11T01:11:46.284968+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:11:46.284968+0000","last_undegraded":"2024-09-11T01:11:46.284968+0000","last_fullsized":"2024-09-11T01:11:46.284968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175684+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T01:12:32.175684+0000","last_peered":"2024-09-11T01:12:32.175684+0000","last_clean":"2024-09-11T01:12:32.175684+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:32.175684+0000","last_undegraded":"2024-09-11T01:12:32.175684+0000","last_fullsized":"2024-09-11T01:12:32.175684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.313491+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T01:12:30.313491+0000","last_peered":"2024-09-11T01:12:30.313491+0000","last_clean":"2024-09-11T01:12:30.313491+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:30.313491+0000","last_undegraded":"2024-09-11T01:12:30.313491+0000","last_fullsized":"2024-09-11T01:12:30.313491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166331+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T01:12:32.166331+0000","last_peered":"2024-09-11T01:12:32.166331+0000","last_clean":"2024-09-11T01:12:32.166331+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:32.166331+0000","last_undegraded":"2024-09-11T01:12:32.166331+0000","last_fullsized":"2024-09-11T01:12:32.166331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1194","reported_seq":1233,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255776+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T01:12:30.255776+0000","last_peered":"2024-09-11T01:12:30.255776+0000","last_clean":"2024-09-11T01:12:30.255776+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:30.255776+0000","last_undegraded":"2024-09-11T01:12:30.255776+0000","last_fullsized":"2024-09-11T01:12:30.255776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.354736+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T01:12:30.354736+0000","last_peered":"2024-09-11T01:12:30.354736+0000","last_clean":"2024-09-11T01:12:30.354736+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:12:30.354736+0000","last_undegraded":"2024-09-11T01:12:30.354736+0000","last_fullsized":"2024-09-11T01:12:30.354736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.158944+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T01:12:32.158944+0000","last_peered":"2024-09-11T01:12:32.158944+0000","last_clean":"2024-09-11T01:12:32.158944+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:32.158944+0000","last_undegraded":"2024-09-11T01:12:32.158944+0000","last_fullsized":"2024-09-11T01:12:32.158944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216270+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T01:12:30.216270+0000","last_peered":"2024-09-11T01:12:30.216270+0000","last_clean":"2024-09-11T01:12:30.216270+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:30.216270+0000","last_undegraded":"2024-09-11T01:12:30.216270+0000","last_fullsized":"2024-09-11T01:12:30.216270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3746,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307169+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T01:12:30.307169+0000","last_peered":"2024-09-11T01:12:30.307169+0000","last_clean":"2024-09-11T01:12:30.307169+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:30.307169+0000","last_undegraded":"2024-09-11T01:12:30.307169+0000","last_fullsized":"2024-09-11T01:12:30.307169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.161667+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T01:12:32.161667+0000","last_peered":"2024-09-11T01:12:32.161667+0000","last_clean":"2024-09-11T01:12:32.161667+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:32.161667+0000","last_undegraded":"2024-09-11T01:12:32.161667+0000","last_fullsized":"2024-09-11T01:12:32.161667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.187936+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T01:12:30.187936+0000","last_peered":"2024-09-11T01:12:30.187936+0000","last_clean":"2024-09-11T01:12:30.187936+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:30.187936+0000","last_undegraded":"2024-09-11T01:12:30.187936+0000","last_fullsized":"2024-09-11T01:12:30.187936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201648+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T01:12:30.201648+0000","last_peered":"2024-09-11T01:12:30.201648+0000","last_clean":"2024-09-11T01:12:30.201648+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:30.201648+0000","last_undegraded":"2024-09-11T01:12:30.201648+0000","last_fullsized":"2024-09-11T01:12:30.201648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.130360+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T01:12:32.130360+0000","last_peered":"2024-09-11T01:12:32.130360+0000","last_clean":"2024-09-11T01:12:32.130360+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:32.130360+0000","last_undegraded":"2024-09-11T01:12:32.130360+0000","last_fullsized":"2024-09-11T01:12:32.130360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:28.875120+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T01:12:28.875120+0000","last_peered":"2024-09-11T01:12:28.875120+0000","last_clean":"2024-09-11T01:12:28.875120+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:28.875120+0000","last_undegraded":"2024-09-11T01:12:28.875120+0000","last_fullsized":"2024-09-11T01:12:28.875120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255530+0000","last_change":"2024-09-11T00:44:57.846986+0000","last_active":"2024-09-11T01:12:30.255530+0000","last_peered":"2024-09-11T01:12:30.255530+0000","last_clean":"2024-09-11T01:12:30.255530+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:30.255530+0000","last_undegraded":"2024-09-11T01:12:30.255530+0000","last_fullsized":"2024-09-11T01:12:30.255530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:48.733442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170735+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T01:12:32.170735+0000","last_peered":"2024-09-11T01:12:32.170735+0000","last_clean":"2024-09-11T01:12:32.170735+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:32.170735+0000","last_undegraded":"2024-09-11T01:12:32.170735+0000","last_fullsized":"2024-09-11T01:12:32.170735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.250636+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T01:12:30.250636+0000","last_peered":"2024-09-11T01:12:30.250636+0000","last_clean":"2024-09-11T01:12:30.250636+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:30.250636+0000","last_undegraded":"2024-09-11T01:12:30.250636+0000","last_fullsized":"2024-09-11T01:12:30.250636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.063655+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T01:12:30.063655+0000","last_peered":"2024-09-11T01:12:30.063655+0000","last_clean":"2024-09-11T01:12:30.063655+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:30.063655+0000","last_undegraded":"2024-09-11T01:12:30.063655+0000","last_fullsized":"2024-09-11T01:12:30.063655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167346+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T01:12:32.167346+0000","last_peered":"2024-09-11T01:12:32.167346+0000","last_clean":"2024-09-11T01:12:32.167346+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:32.167346+0000","last_undegraded":"2024-09-11T01:12:32.167346+0000","last_fullsized":"2024-09-11T01:12:32.167346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.834664+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T01:12:31.834664+0000","last_peered":"2024-09-11T01:12:31.834664+0000","last_clean":"2024-09-11T01:12:31.834664+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:31.834664+0000","last_undegraded":"2024-09-11T01:12:31.834664+0000","last_fullsized":"2024-09-11T01:12:31.834664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.297988+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T01:12:30.297988+0000","last_peered":"2024-09-11T01:12:30.297988+0000","last_clean":"2024-09-11T01:12:30.297988+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:30.297988+0000","last_undegraded":"2024-09-11T01:12:30.297988+0000","last_fullsized":"2024-09-11T01:12:30.297988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.163013+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T01:12:32.163013+0000","last_peered":"2024-09-11T01:12:32.163013+0000","last_clean":"2024-09-11T01:12:32.163013+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:32.163013+0000","last_undegraded":"2024-09-11T01:12:32.163013+0000","last_fullsized":"2024-09-11T01:12:32.163013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.185446+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T01:12:30.185446+0000","last_peered":"2024-09-11T01:12:30.185446+0000","last_clean":"2024-09-11T01:12:30.185446+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:30.185446+0000","last_undegraded":"2024-09-11T01:12:30.185446+0000","last_fullsized":"2024-09-11T01:12:30.185446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.300655+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T01:12:30.300655+0000","last_peered":"2024-09-11T01:12:30.300655+0000","last_clean":"2024-09-11T01:12:30.300655+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:30.300655+0000","last_undegraded":"2024-09-11T01:12:30.300655+0000","last_fullsized":"2024-09-11T01:12:30.300655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174302+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T01:12:32.174302+0000","last_peered":"2024-09-11T01:12:32.174302+0000","last_clean":"2024-09-11T01:12:32.174302+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:32.174302+0000","last_undegraded":"2024-09-11T01:12:32.174302+0000","last_fullsized":"2024-09-11T01:12:32.174302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.272321+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T01:12:30.272321+0000","last_peered":"2024-09-11T01:12:30.272321+0000","last_clean":"2024-09-11T01:12:30.272321+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:30.272321+0000","last_undegraded":"2024-09-11T01:12:30.272321+0000","last_fullsized":"2024-09-11T01:12:30.272321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4028,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216415+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T01:12:30.216415+0000","last_peered":"2024-09-11T01:12:30.216415+0000","last_clean":"2024-09-11T01:12:30.216415+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:30.216415+0000","last_undegraded":"2024-09-11T01:12:30.216415+0000","last_fullsized":"2024-09-11T01:12:30.216415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173660+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T01:12:32.173660+0000","last_peered":"2024-09-11T01:12:32.173660+0000","last_clean":"2024-09-11T01:12:32.173660+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:32.173660+0000","last_undegraded":"2024-09-11T01:12:32.173660+0000","last_fullsized":"2024-09-11T01:12:32.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.246446+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T01:12:30.246446+0000","last_peered":"2024-09-11T01:12:30.246446+0000","last_clean":"2024-09-11T01:12:30.246446+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:30.246446+0000","last_undegraded":"2024-09-11T01:12:30.246446+0000","last_fullsized":"2024-09-11T01:12:30.246446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.312745+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T01:12:30.312745+0000","last_peered":"2024-09-11T01:12:30.312745+0000","last_clean":"2024-09-11T01:12:30.312745+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:30.312745+0000","last_undegraded":"2024-09-11T01:12:30.312745+0000","last_fullsized":"2024-09-11T01:12:30.312745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176246+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T01:12:32.176246+0000","last_peered":"2024-09-11T01:12:32.176246+0000","last_clean":"2024-09-11T01:12:32.176246+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:32.176246+0000","last_undegraded":"2024-09-11T01:12:32.176246+0000","last_fullsized":"2024-09-11T01:12:32.176246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.860216+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T01:12:32.860216+0000","last_peered":"2024-09-11T01:12:32.860216+0000","last_clean":"2024-09-11T01:12:32.860216+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:32.860216+0000","last_undegraded":"2024-09-11T01:12:32.860216+0000","last_fullsized":"2024-09-11T01:12:32.860216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345927+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T01:12:30.345927+0000","last_peered":"2024-09-11T01:12:30.345927+0000","last_clean":"2024-09-11T01:12:30.345927+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:12:30.345927+0000","last_undegraded":"2024-09-11T01:12:30.345927+0000","last_fullsized":"2024-09-11T01:12:30.345927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.160741+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T01:12:32.160741+0000","last_peered":"2024-09-11T01:12:32.160741+0000","last_clean":"2024-09-11T01:12:32.160741+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:32.160741+0000","last_undegraded":"2024-09-11T01:12:32.160741+0000","last_fullsized":"2024-09-11T01:12:32.160741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.287905+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T01:12:30.287905+0000","last_peered":"2024-09-11T01:12:30.287905+0000","last_clean":"2024-09-11T01:12:30.287905+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:30.287905+0000","last_undegraded":"2024-09-11T01:12:30.287905+0000","last_fullsized":"2024-09-11T01:12:30.287905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.167008+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T01:12:30.167008+0000","last_peered":"2024-09-11T01:12:30.167008+0000","last_clean":"2024-09-11T01:12:30.167008+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:12:30.167008+0000","last_undegraded":"2024-09-11T01:12:30.167008+0000","last_fullsized":"2024-09-11T01:12:30.167008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176022+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T01:12:32.176022+0000","last_peered":"2024-09-11T01:12:32.176022+0000","last_clean":"2024-09-11T01:12:32.176022+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:32.176022+0000","last_undegraded":"2024-09-11T01:12:32.176022+0000","last_fullsized":"2024-09-11T01:12:32.176022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:09:14.875043+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T01:09:14.875043+0000","last_peered":"2024-09-11T01:09:14.875043+0000","last_clean":"2024-09-11T01:09:14.875043+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:09:14.875043+0000","last_undegraded":"2024-09-11T01:09:14.875043+0000","last_fullsized":"2024-09-11T01:09:14.875043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:12.301491+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T01:10:12.301491+0000","last_peered":"2024-09-11T01:10:12.301491+0000","last_clean":"2024-09-11T01:10:12.301491+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:10:12.301491+0000","last_undegraded":"2024-09-11T01:10:12.301491+0000","last_fullsized":"2024-09-11T01:10:12.301491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3469,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.218838+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T01:12:30.218838+0000","last_peered":"2024-09-11T01:12:30.218838+0000","last_clean":"2024-09-11T01:12:30.218838+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:12:30.218838+0000","last_undegraded":"2024-09-11T01:12:30.218838+0000","last_fullsized":"2024-09-11T01:12:30.218838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166643+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T01:12:32.166643+0000","last_peered":"2024-09-11T01:12:32.166643+0000","last_clean":"2024-09-11T01:12:32.166643+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:32.166643+0000","last_undegraded":"2024-09-11T01:12:32.166643+0000","last_fullsized":"2024-09-11T01:12:32.166643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:18.897991+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T01:11:18.897991+0000","last_peered":"2024-09-11T01:11:18.897991+0000","last_clean":"2024-09-11T01:11:18.897991+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:11:18.897991+0000","last_undegraded":"2024-09-11T01:11:18.897991+0000","last_fullsized":"2024-09-11T01:11:18.897991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3631,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307081+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T01:12:30.307081+0000","last_peered":"2024-09-11T01:12:30.307081+0000","last_clean":"2024-09-11T01:12:30.307081+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:30.307081+0000","last_undegraded":"2024-09-11T01:12:30.307081+0000","last_fullsized":"2024-09-11T01:12:30.307081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173027+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T01:12:32.173027+0000","last_peered":"2024-09-11T01:12:32.173027+0000","last_clean":"2024-09-11T01:12:32.173027+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:32.173027+0000","last_undegraded":"2024-09-11T01:12:32.173027+0000","last_fullsized":"2024-09-11T01:12:32.173027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:17.487776+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T01:11:17.487776+0000","last_peered":"2024-09-11T01:11:17.487776+0000","last_clean":"2024-09-11T01:11:17.487776+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:11:17.487776+0000","last_undegraded":"2024-09-11T01:11:17.487776+0000","last_fullsized":"2024-09-11T01:11:17.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3590,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.322566+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T01:12:30.322566+0000","last_peered":"2024-09-11T01:12:30.322566+0000","last_clean":"2024-09-11T01:12:30.322566+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:12:30.322566+0000","last_undegraded":"2024-09-11T01:12:30.322566+0000","last_fullsized":"2024-09-11T01:12:30.322566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178797+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T01:12:32.178797+0000","last_peered":"2024-09-11T01:12:32.178797+0000","last_clean":"2024-09-11T01:12:32.178797+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:32.178797+0000","last_undegraded":"2024-09-11T01:12:32.178797+0000","last_fullsized":"2024-09-11T01:12:32.178797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.233378+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T01:12:30.233378+0000","last_peered":"2024-09-11T01:12:30.233378+0000","last_clean":"2024-09-11T01:12:30.233378+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:30.233378+0000","last_undegraded":"2024-09-11T01:12:30.233378+0000","last_fullsized":"2024-09-11T01:12:30.233378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.210070+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T01:12:30.210070+0000","last_peered":"2024-09-11T01:12:30.210070+0000","last_clean":"2024-09-11T01:12:30.210070+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:12:30.210070+0000","last_undegraded":"2024-09-11T01:12:30.210070+0000","last_fullsized":"2024-09-11T01:12:30.210070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.184097+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T01:12:32.184097+0000","last_peered":"2024-09-11T01:12:32.184097+0000","last_clean":"2024-09-11T01:12:32.184097+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:32.184097+0000","last_undegraded":"2024-09-11T01:12:32.184097+0000","last_fullsized":"2024-09-11T01:12:32.184097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298932+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T01:12:30.298932+0000","last_peered":"2024-09-11T01:12:30.298932+0000","last_clean":"2024-09-11T01:12:30.298932+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:30.298932+0000","last_undegraded":"2024-09-11T01:12:30.298932+0000","last_fullsized":"2024-09-11T01:12:30.298932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3473,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.353343+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T01:12:30.353343+0000","last_peered":"2024-09-11T01:12:30.353343+0000","last_clean":"2024-09-11T01:12:30.353343+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:30.353343+0000","last_undegraded":"2024-09-11T01:12:30.353343+0000","last_fullsized":"2024-09-11T01:12:30.353343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170446+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T01:12:32.170446+0000","last_peered":"2024-09-11T01:12:32.170446+0000","last_clean":"2024-09-11T01:12:32.170446+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:32.170446+0000","last_undegraded":"2024-09-11T01:12:32.170446+0000","last_fullsized":"2024-09-11T01:12:32.170446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.257538+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T01:12:30.257538+0000","last_peered":"2024-09-11T01:12:30.257538+0000","last_clean":"2024-09-11T01:12:30.257538+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:30.257538+0000","last_undegraded":"2024-09-11T01:12:30.257538+0000","last_fullsized":"2024-09-11T01:12:30.257538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267004+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T01:12:30.267004+0000","last_peered":"2024-09-11T01:12:30.267004+0000","last_clean":"2024-09-11T01:12:30.267004+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:12:30.267004+0000","last_undegraded":"2024-09-11T01:12:30.267004+0000","last_fullsized":"2024-09-11T01:12:30.267004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.165269+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T01:12:32.165269+0000","last_peered":"2024-09-11T01:12:32.165269+0000","last_clean":"2024-09-11T01:12:32.165269+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:32.165269+0000","last_undegraded":"2024-09-11T01:12:32.165269+0000","last_fullsized":"2024-09-11T01:12:32.165269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.244504+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T01:12:30.244504+0000","last_peered":"2024-09-11T01:12:30.244504+0000","last_clean":"2024-09-11T01:12:30.244504+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:30.244504+0000","last_undegraded":"2024-09-11T01:12:30.244504+0000","last_fullsized":"2024-09-11T01:12:30.244504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.318719+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T01:12:30.318719+0000","last_peered":"2024-09-11T01:12:30.318719+0000","last_clean":"2024-09-11T01:12:30.318719+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:12:30.318719+0000","last_undegraded":"2024-09-11T01:12:30.318719+0000","last_fullsized":"2024-09-11T01:12:30.318719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174988+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T01:12:32.174988+0000","last_peered":"2024-09-11T01:12:32.174988+0000","last_clean":"2024-09-11T01:12:32.174988+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:32.174988+0000","last_undegraded":"2024-09-11T01:12:32.174988+0000","last_fullsized":"2024-09-11T01:12:32.174988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.180576+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T01:12:30.180576+0000","last_peered":"2024-09-11T01:12:30.180576+0000","last_clean":"2024-09-11T01:12:30.180576+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:30.180576+0000","last_undegraded":"2024-09-11T01:12:30.180576+0000","last_fullsized":"2024-09-11T01:12:30.180576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.348920+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T01:12:30.348920+0000","last_peered":"2024-09-11T01:12:30.348920+0000","last_clean":"2024-09-11T01:12:30.348920+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:30.348920+0000","last_undegraded":"2024-09-11T01:12:30.348920+0000","last_fullsized":"2024-09-11T01:12:30.348920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164904+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T01:12:32.164904+0000","last_peered":"2024-09-11T01:12:32.164904+0000","last_clean":"2024-09-11T01:12:32.164904+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:32.164904+0000","last_undegraded":"2024-09-11T01:12:32.164904+0000","last_fullsized":"2024-09-11T01:12:32.164904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256368+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T01:12:30.256368+0000","last_peered":"2024-09-11T01:12:30.256368+0000","last_clean":"2024-09-11T01:12:30.256368+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:30.256368+0000","last_undegraded":"2024-09-11T01:12:30.256368+0000","last_fullsized":"2024-09-11T01:12:30.256368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3514,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.053069+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T01:12:30.053069+0000","last_peered":"2024-09-11T01:12:30.053069+0000","last_clean":"2024-09-11T01:12:30.053069+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:12:30.053069+0000","last_undegraded":"2024-09-11T01:12:30.053069+0000","last_fullsized":"2024-09-11T01:12:30.053069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172462+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T01:12:32.172462+0000","last_peered":"2024-09-11T01:12:32.172462+0000","last_clean":"2024-09-11T01:12:32.172462+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:32.172462+0000","last_undegraded":"2024-09-11T01:12:32.172462+0000","last_fullsized":"2024-09-11T01:12:32.172462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'367","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.252206+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T01:12:30.252206+0000","last_peered":"2024-09-11T01:12:30.252206+0000","last_clean":"2024-09-11T01:12:30.252206+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:30.252206+0000","last_undegraded":"2024-09-11T01:12:30.252206+0000","last_fullsized":"2024-09-11T01:12:30.252206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3580,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.134688+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T01:12:30.134688+0000","last_peered":"2024-09-11T01:12:30.134688+0000","last_clean":"2024-09-11T01:12:30.134688+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:30.134688+0000","last_undegraded":"2024-09-11T01:12:30.134688+0000","last_fullsized":"2024-09-11T01:12:30.134688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178305+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T01:12:32.178305+0000","last_peered":"2024-09-11T01:12:32.178305+0000","last_clean":"2024-09-11T01:12:32.178305+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:32.178305+0000","last_undegraded":"2024-09-11T01:12:32.178305+0000","last_fullsized":"2024-09-11T01:12:32.178305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.863603+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T01:12:31.863603+0000","last_peered":"2024-09-11T01:12:31.863603+0000","last_clean":"2024-09-11T01:12:31.863603+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:31.863603+0000","last_undegraded":"2024-09-11T01:12:31.863603+0000","last_fullsized":"2024-09-11T01:12:31.863603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3760,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345509+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T01:12:30.345509+0000","last_peered":"2024-09-11T01:12:30.345509+0000","last_clean":"2024-09-11T01:12:30.345509+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:30.345509+0000","last_undegraded":"2024-09-11T01:12:30.345509+0000","last_fullsized":"2024-09-11T01:12:30.345509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177439+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T01:12:32.177439+0000","last_peered":"2024-09-11T01:12:32.177439+0000","last_clean":"2024-09-11T01:12:32.177439+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:32.177439+0000","last_undegraded":"2024-09-11T01:12:32.177439+0000","last_fullsized":"2024-09-11T01:12:32.177439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.145668+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T01:12:30.145668+0000","last_peered":"2024-09-11T01:12:30.145668+0000","last_clean":"2024-09-11T01:12:30.145668+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:30.145668+0000","last_undegraded":"2024-09-11T01:12:30.145668+0000","last_fullsized":"2024-09-11T01:12:30.145668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201774+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T01:12:30.201774+0000","last_peered":"2024-09-11T01:12:30.201774+0000","last_clean":"2024-09-11T01:12:30.201774+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:30.201774+0000","last_undegraded":"2024-09-11T01:12:30.201774+0000","last_fullsized":"2024-09-11T01:12:30.201774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183382+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T01:12:32.183382+0000","last_peered":"2024-09-11T01:12:32.183382+0000","last_clean":"2024-09-11T01:12:32.183382+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:32.183382+0000","last_undegraded":"2024-09-11T01:12:32.183382+0000","last_fullsized":"2024-09-11T01:12:32.183382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.251283+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T01:10:53.251283+0000","last_peered":"2024-09-11T01:10:53.251283+0000","last_clean":"2024-09-11T01:10:53.251283+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:10:53.251283+0000","last_undegraded":"2024-09-11T01:10:53.251283+0000","last_fullsized":"2024-09-11T01:10:53.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4011,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.293685+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T01:12:30.293685+0000","last_peered":"2024-09-11T01:12:30.293685+0000","last_clean":"2024-09-11T01:12:30.293685+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:30.293685+0000","last_undegraded":"2024-09-11T01:12:30.293685+0000","last_fullsized":"2024-09-11T01:12:30.293685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.341995+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T01:12:30.341995+0000","last_peered":"2024-09-11T01:12:30.341995+0000","last_clean":"2024-09-11T01:12:30.341995+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:12:30.341995+0000","last_undegraded":"2024-09-11T01:12:30.341995+0000","last_fullsized":"2024-09-11T01:12:30.341995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174011+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T01:12:32.174011+0000","last_peered":"2024-09-11T01:12:32.174011+0000","last_clean":"2024-09-11T01:12:32.174011+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:32.174011+0000","last_undegraded":"2024-09-11T01:12:32.174011+0000","last_fullsized":"2024-09-11T01:12:32.174011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:29.280855+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T01:12:29.280855+0000","last_peered":"2024-09-11T01:12:29.280855+0000","last_clean":"2024-09-11T01:12:29.280855+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:29.280855+0000","last_undegraded":"2024-09-11T01:12:29.280855+0000","last_fullsized":"2024-09-11T01:12:29.280855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.279045+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T01:12:30.279045+0000","last_peered":"2024-09-11T01:12:30.279045+0000","last_clean":"2024-09-11T01:12:30.279045+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:12:30.279045+0000","last_undegraded":"2024-09-11T01:12:30.279045+0000","last_fullsized":"2024-09-11T01:12:30.279045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176842+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T01:12:32.176842+0000","last_peered":"2024-09-11T01:12:32.176842+0000","last_clean":"2024-09-11T01:12:32.176842+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:32.176842+0000","last_undegraded":"2024-09-11T01:12:32.176842+0000","last_fullsized":"2024-09-11T01:12:32.176842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.182691+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T01:10:53.182691+0000","last_peered":"2024-09-11T01:10:53.182691+0000","last_clean":"2024-09-11T01:10:53.182691+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:10:53.182691+0000","last_undegraded":"2024-09-11T01:10:53.182691+0000","last_fullsized":"2024-09-11T01:10:53.182691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267800+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T01:12:30.267800+0000","last_peered":"2024-09-11T01:12:30.267800+0000","last_clean":"2024-09-11T01:12:30.267800+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:30.267800+0000","last_undegraded":"2024-09-11T01:12:30.267800+0000","last_fullsized":"2024-09-11T01:12:30.267800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177191+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T01:12:32.177191+0000","last_peered":"2024-09-11T01:12:32.177191+0000","last_clean":"2024-09-11T01:12:32.177191+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:32.177191+0000","last_undegraded":"2024-09-11T01:12:32.177191+0000","last_fullsized":"2024-09-11T01:12:32.177191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3060,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.022723+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T01:12:30.022723+0000","last_peered":"2024-09-11T01:12:30.022723+0000","last_clean":"2024-09-11T01:12:30.022723+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:30.022723+0000","last_undegraded":"2024-09-11T01:12:30.022723+0000","last_fullsized":"2024-09-11T01:12:30.022723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'608","reported_seq":646,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:47.550566+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T01:11:47.550566+0000","last_peered":"2024-09-11T01:11:47.550566+0000","last_clean":"2024-09-11T01:11:47.550566+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:11:47.550566+0000","last_undegraded":"2024-09-11T01:11:47.550566+0000","last_fullsized":"2024-09-11T01:11:47.550566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180166+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T01:12:32.180166+0000","last_peered":"2024-09-11T01:12:32.180166+0000","last_clean":"2024-09-11T01:12:32.180166+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:32.180166+0000","last_undegraded":"2024-09-11T01:12:32.180166+0000","last_fullsized":"2024-09-11T01:12:32.180166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298969+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T01:12:30.298969+0000","last_peered":"2024-09-11T01:12:30.298969+0000","last_clean":"2024-09-11T01:12:30.298969+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:30.298969+0000","last_undegraded":"2024-09-11T01:12:30.298969+0000","last_fullsized":"2024-09-11T01:12:30.298969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167609+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T01:12:32.167609+0000","last_peered":"2024-09-11T01:12:32.167609+0000","last_clean":"2024-09-11T01:12:32.167609+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:32.167609+0000","last_undegraded":"2024-09-11T01:12:32.167609+0000","last_fullsized":"2024-09-11T01:12:32.167609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.159359+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T01:12:32.159359+0000","last_peered":"2024-09-11T01:12:32.159359+0000","last_clean":"2024-09-11T01:12:32.159359+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:32.159359+0000","last_undegraded":"2024-09-11T01:12:32.159359+0000","last_fullsized":"2024-09-11T01:12:32.159359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178354+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T01:12:32.178354+0000","last_peered":"2024-09-11T01:12:32.178354+0000","last_clean":"2024-09-11T01:12:32.178354+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:32.178354+0000","last_undegraded":"2024-09-11T01:12:32.178354+0000","last_fullsized":"2024-09-11T01:12:32.178354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175700+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T01:12:32.175700+0000","last_peered":"2024-09-11T01:12:32.175700+0000","last_clean":"2024-09-11T01:12:32.175700+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:32.175700+0000","last_undegraded":"2024-09-11T01:12:32.175700+0000","last_fullsized":"2024-09-11T01:12:32.175700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177831+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T01:12:32.177831+0000","last_peered":"2024-09-11T01:12:32.177831+0000","last_clean":"2024-09-11T01:12:32.177831+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:32.177831+0000","last_undegraded":"2024-09-11T01:12:32.177831+0000","last_fullsized":"2024-09-11T01:12:32.177831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.152165+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T01:12:32.152165+0000","last_peered":"2024-09-11T01:12:32.152165+0000","last_clean":"2024-09-11T01:12:32.152165+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:32.152165+0000","last_undegraded":"2024-09-11T01:12:32.152165+0000","last_fullsized":"2024-09-11T01:12:32.152165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183309+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T01:12:32.183309+0000","last_peered":"2024-09-11T01:12:32.183309+0000","last_clean":"2024-09-11T01:12:32.183309+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:32.183309+0000","last_undegraded":"2024-09-11T01:12:32.183309+0000","last_fullsized":"2024-09-11T01:12:32.183309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175313+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T01:12:32.175313+0000","last_peered":"2024-09-11T01:12:32.175313+0000","last_clean":"2024-09-11T01:12:32.175313+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:32.175313+0000","last_undegraded":"2024-09-11T01:12:32.175313+0000","last_fullsized":"2024-09-11T01:12:32.175313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178446+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T01:12:32.178446+0000","last_peered":"2024-09-11T01:12:32.178446+0000","last_clean":"2024-09-11T01:12:32.178446+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:12:32.178446+0000","last_undegraded":"2024-09-11T01:12:32.178446+0000","last_fullsized":"2024-09-11T01:12:32.178446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.179104+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T01:12:32.179104+0000","last_peered":"2024-09-11T01:12:32.179104+0000","last_clean":"2024-09-11T01:12:32.179104+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:32.179104+0000","last_undegraded":"2024-09-11T01:12:32.179104+0000","last_fullsized":"2024-09-11T01:12:32.179104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170124+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T01:12:32.170124+0000","last_peered":"2024-09-11T01:12:32.170124+0000","last_clean":"2024-09-11T01:12:32.170124+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:32.170124+0000","last_undegraded":"2024-09-11T01:12:32.170124+0000","last_fullsized":"2024-09-11T01:12:32.170124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180410+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T01:12:32.180410+0000","last_peered":"2024-09-11T01:12:32.180410+0000","last_clean":"2024-09-11T01:12:32.180410+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:32.180410+0000","last_undegraded":"2024-09-11T01:12:32.180410+0000","last_fullsized":"2024-09-11T01:12:32.180410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177471+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T01:12:32.177471+0000","last_peered":"2024-09-11T01:12:32.177471+0000","last_clean":"2024-09-11T01:12:32.177471+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:32.177471+0000","last_undegraded":"2024-09-11T01:12:32.177471+0000","last_fullsized":"2024-09-11T01:12:32.177471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169364+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T01:12:32.169364+0000","last_peered":"2024-09-11T01:12:32.169364+0000","last_clean":"2024-09-11T01:12:32.169364+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:12:32.169364+0000","last_undegraded":"2024-09-11T01:12:32.169364+0000","last_fullsized":"2024-09-11T01:12:32.169364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.168873+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T01:12:32.168873+0000","last_peered":"2024-09-11T01:12:32.168873+0000","last_clean":"2024-09-11T01:12:32.168873+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:32.168873+0000","last_undegraded":"2024-09-11T01:12:32.168873+0000","last_fullsized":"2024-09-11T01:12:32.168873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174517+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T01:12:32.174517+0000","last_peered":"2024-09-11T01:12:32.174517+0000","last_clean":"2024-09-11T01:12:32.174517+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:12:32.174517+0000","last_undegraded":"2024-09-11T01:12:32.174517+0000","last_fullsized":"2024-09-11T01:12:32.174517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.171124+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T01:12:32.171124+0000","last_peered":"2024-09-11T01:12:32.171124+0000","last_clean":"2024-09-11T01:12:32.171124+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:12:32.171124+0000","last_undegraded":"2024-09-11T01:12:32.171124+0000","last_fullsized":"2024-09-11T01:12:32.171124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175872+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T01:12:32.175872+0000","last_peered":"2024-09-11T01:12:32.175872+0000","last_clean":"2024-09-11T01:12:32.175872+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:32.175872+0000","last_undegraded":"2024-09-11T01:12:32.175872+0000","last_fullsized":"2024-09-11T01:12:32.175872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.155284+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T01:12:32.155284+0000","last_peered":"2024-09-11T01:12:32.155284+0000","last_clean":"2024-09-11T01:12:32.155284+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:32.155284+0000","last_undegraded":"2024-09-11T01:12:32.155284+0000","last_fullsized":"2024-09-11T01:12:32.155284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169520+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T01:12:32.169520+0000","last_peered":"2024-09-11T01:12:32.169520+0000","last_clean":"2024-09-11T01:12:32.169520+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:32.169520+0000","last_undegraded":"2024-09-11T01:12:32.169520+0000","last_fullsized":"2024-09-11T01:12:32.169520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180898+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T01:12:32.180898+0000","last_peered":"2024-09-11T01:12:32.180898+0000","last_clean":"2024-09-11T01:12:32.180898+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:32.180898+0000","last_undegraded":"2024-09-11T01:12:32.180898+0000","last_fullsized":"2024-09-11T01:12:32.180898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172147+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T01:12:32.172147+0000","last_peered":"2024-09-11T01:12:32.172147+0000","last_clean":"2024-09-11T01:12:32.172147+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:32.172147+0000","last_undegraded":"2024-09-11T01:12:32.172147+0000","last_fullsized":"2024-09-11T01:12:32.172147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181309+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T01:12:32.181309+0000","last_peered":"2024-09-11T01:12:32.181309+0000","last_clean":"2024-09-11T01:12:32.181309+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:32.181309+0000","last_undegraded":"2024-09-11T01:12:32.181309+0000","last_fullsized":"2024-09-11T01:12:32.181309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166759+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T01:12:32.166759+0000","last_peered":"2024-09-11T01:12:32.166759+0000","last_clean":"2024-09-11T01:12:32.166759+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:32.166759+0000","last_undegraded":"2024-09-11T01:12:32.166759+0000","last_fullsized":"2024-09-11T01:12:32.166759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180470+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T01:12:32.180470+0000","last_peered":"2024-09-11T01:12:32.180470+0000","last_clean":"2024-09-11T01:12:32.180470+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:32.180470+0000","last_undegraded":"2024-09-11T01:12:32.180470+0000","last_fullsized":"2024-09-11T01:12:32.180470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164129+0000","last_change":"2024-09-11T00:44:57.516134+0000","last_active":"2024-09-11T01:12:32.164129+0000","last_peered":"2024-09-11T01:12:32.164129+0000","last_clean":"2024-09-11T01:12:32.164129+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:32.164129+0000","last_undegraded":"2024-09-11T01:12:32.164129+0000","last_fullsized":"2024-09-11T01:12:32.164129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175616+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T01:12:32.175616+0000","last_peered":"2024-09-11T01:12:32.175616+0000","last_clean":"2024-09-11T01:12:32.175616+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:32.175616+0000","last_undegraded":"2024-09-11T01:12:32.175616+0000","last_fullsized":"2024-09-11T01:12:32.175616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177037+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T01:12:32.177037+0000","last_peered":"2024-09-11T01:12:32.177037+0000","last_clean":"2024-09-11T01:12:32.177037+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:32.177037+0000","last_undegraded":"2024-09-11T01:12:32.177037+0000","last_fullsized":"2024-09-11T01:12:32.177037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177662+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T01:12:32.177662+0000","last_peered":"2024-09-11T01:12:32.177662+0000","last_clean":"2024-09-11T01:12:32.177662+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:32.177662+0000","last_undegraded":"2024-09-11T01:12:32.177662+0000","last_fullsized":"2024-09-11T01:12:32.177662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175993+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T01:12:32.175993+0000","last_peered":"2024-09-11T01:12:32.175993+0000","last_clean":"2024-09-11T01:12:32.175993+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:32.175993+0000","last_undegraded":"2024-09-11T01:12:32.175993+0000","last_fullsized":"2024-09-11T01:12:32.175993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166210+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T01:12:32.166210+0000","last_peered":"2024-09-11T01:12:32.166210+0000","last_clean":"2024-09-11T01:12:32.166210+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:32.166210+0000","last_undegraded":"2024-09-11T01:12:32.166210+0000","last_fullsized":"2024-09-11T01:12:32.166210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173362+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T01:12:32.173362+0000","last_peered":"2024-09-11T01:12:32.173362+0000","last_clean":"2024-09-11T01:12:32.173362+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:32.173362+0000","last_undegraded":"2024-09-11T01:12:32.173362+0000","last_fullsized":"2024-09-11T01:12:32.173362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15867448,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3777,"num_write_kb":16855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31734896,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3296,"ondisk_log_size":3296,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509783,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7507902,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574232,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93797608,"statfs":{"total":96636764160,"available":96048750592,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509783,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509784,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7508664,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7383683,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7384445,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:12:39.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 -- 172.21.15.81:0/255252337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8484004d40 msgr2=0x7f84840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 --2- 172.21.15.81:0/255252337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8484004d40 0x7f84840051c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f84a00711b0 tx=0x7f8484005830 comp rx=0 tx=0).stop 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f849f400640 1 -- 172.21.15.81:0/255252337 reap_dead start 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 -- 172.21.15.81:0/255252337 shutdown_connections 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 -- 172.21.15.81:0/255252337 >> 172.21.15.81:0/255252337 conn(0x7f84a00700f0 msgr2=0x7f84a0070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 -- 172.21.15.81:0/255252337 shutdown_connections 2024-09-11T01:12:39.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.295+0000 7f84a5a00640 1 -- 172.21.15.81:0/255252337 wait complete. 2024-09-11T01:12:39.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.297+0000 7f84a5a00640 1 Processor -- start 2024-09-11T01:12:39.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.297+0000 7f84a5a00640 1 -- start start 2024-09-11T01:12:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8484004d40 0x7f84a014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 0x7f84a0155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0070cf0 con 0x7f84a0155a40 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84a015c140 con 0x7f84a01531b0 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f84a5a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f84a01529f0 con 0x7f8484004d40 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50878/0 (socket says 172.21.15.81:50878) 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 -- 172.21.15.81:0/3927123872 learned_addr learned my addr 172.21.15.81:0/3927123872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849ea00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8484004d40 0x7f84a014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849e000640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 0x7f84a0155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 -- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8484004d40 msgr2=0x7f84a014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8484004d40 0x7f84a014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 -- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 msgr2=0x7f84a0155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 0x7f84a0155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849f400640 1 -- 172.21.15.81:0/3927123872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a00b09c0 con 0x7f84a0155a40 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.298+0000 7f849e000640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 0x7f84a0155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f849f400640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f849800c6d0 tx=0x7f8498001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498039070 con 0x7f84a0155a40 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f849802ba70 con 0x7f84a0155a40 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498002030 con 0x7f84a0155a40 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a01f11a0 con 0x7f84a0155a40 2024-09-11T01:12:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.299+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a01f1460 con 0x7f84a0155a40 2024-09-11T01:12:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.300+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a006def0 con 0x7f84a0155a40 2024-09-11T01:12:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.301+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8498034680 con 0x7f84a0155a40 2024-09-11T01:12:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.302+0000 7f8496a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 0x7f848007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.302+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f84980b9ff0 con 0x7f84a0155a40 2024-09-11T01:12:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.303+0000 7f849ea00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 0x7f848007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.303+0000 7f849ea00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 0x7f848007a430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8490009c50 tx=0x7f8490005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.306+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f84a006def0 con 0x7f84a0155a40 2024-09-11T01:12:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.487+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84a00b22f0 con 0x7f8480077f70 2024-09-11T01:12:39.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.493+0000 7f8496a00640 1 -- 172.21.15.81:0/3927123872 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334149 (secure 0 0 0) 0x7f8490072960 con 0x7f8480077f70 2024-09-11T01:12:39.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:12:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 msgr2=0x7f848007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 0x7f848007a430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8490009c50 tx=0x7f8490005f90 comp rx=0 tx=0).stop 2024-09-11T01:12:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 msgr2=0x7f84a01f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f849800c6d0 tx=0x7f8498001aa0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 shutdown_connections 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8480077f70 0x7f848007a430 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a0155a40 0x7f84a01f40b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a01531b0 0x7f84a0155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 --2- 172.21.15.81:0/3927123872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8484004d40 0x7f84a014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.498+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 >> 172.21.15.81:0/3927123872 conn(0x7f84a00700f0 msgr2=0x7f84a0150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.499+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 shutdown_connections 2024-09-11T01:12:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.499+0000 7f84a5a00640 1 -- 172.21.15.81:0/3927123872 wait complete. 2024-09-11T01:12:39.515 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":880,"stamp":"2024-09-11T01:12:38.336549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16457816,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617527,"num_write_kb":15568565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122311,"ondisk_log_size":122311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5099712,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5076531,"kb_avail":749875008,"statfs":{"total":773094113280,"available":767872008192,"internally_reserved":0,"allocated":23592960,"data_stored":33909384,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5198368305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1679016204,"num_objects":-600,"num_object_clones":0,"num_object_copies":-2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-600,"num_whiteouts":0,"num_read":6,"num_read_kb":34,"num_write":710,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003776"},"pg_stats":[{"pgid":"2.1f","version":"29'455","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.186156+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T01:12:32.186156+0000","last_peered":"2024-09-11T01:12:32.186156+0000","last_clean":"2024-09-11T01:12:32.186156+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:32.186156+0000","last_undegraded":"2024-09-11T01:12:32.186156+0000","last_fullsized":"2024-09-11T01:12:32.186156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189379,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":3331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180955+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T01:12:32.180955+0000","last_peered":"2024-09-11T01:12:32.180955+0000","last_clean":"2024-09-11T01:12:32.180955+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:32.180955+0000","last_undegraded":"2024-09-11T01:12:32.180955+0000","last_fullsized":"2024-09-11T01:12:32.180955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4034,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.363576+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T01:12:30.363576+0000","last_peered":"2024-09-11T01:12:30.363576+0000","last_clean":"2024-09-11T01:12:30.363576+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:30.363576+0000","last_undegraded":"2024-09-11T01:12:30.363576+0000","last_fullsized":"2024-09-11T01:12:30.363576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256931+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T01:12:30.256931+0000","last_peered":"2024-09-11T01:12:30.256931+0000","last_clean":"2024-09-11T01:12:30.256931+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:30.256931+0000","last_undegraded":"2024-09-11T01:12:30.256931+0000","last_fullsized":"2024-09-11T01:12:30.256931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181533+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T01:12:32.181533+0000","last_peered":"2024-09-11T01:12:32.181533+0000","last_clean":"2024-09-11T01:12:32.181533+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:32.181533+0000","last_undegraded":"2024-09-11T01:12:32.181533+0000","last_fullsized":"2024-09-11T01:12:32.181533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.346355+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T01:12:30.346355+0000","last_peered":"2024-09-11T01:12:30.346355+0000","last_clean":"2024-09-11T01:12:30.346355+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:30.346355+0000","last_undegraded":"2024-09-11T01:12:30.346355+0000","last_fullsized":"2024-09-11T01:12:30.346355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.304546+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T01:12:30.304546+0000","last_peered":"2024-09-11T01:12:30.304546+0000","last_clean":"2024-09-11T01:12:30.304546+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:30.304546+0000","last_undegraded":"2024-09-11T01:12:30.304546+0000","last_fullsized":"2024-09-11T01:12:30.304546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180664+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T01:12:32.180664+0000","last_peered":"2024-09-11T01:12:32.180664+0000","last_clean":"2024-09-11T01:12:32.180664+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:32.180664+0000","last_undegraded":"2024-09-11T01:12:32.180664+0000","last_fullsized":"2024-09-11T01:12:32.180664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3815,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.340870+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T01:12:30.340870+0000","last_peered":"2024-09-11T01:12:30.340870+0000","last_clean":"2024-09-11T01:12:30.340870+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:30.340870+0000","last_undegraded":"2024-09-11T01:12:30.340870+0000","last_fullsized":"2024-09-11T01:12:30.340870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:46.284968+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T01:11:46.284968+0000","last_peered":"2024-09-11T01:11:46.284968+0000","last_clean":"2024-09-11T01:11:46.284968+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:11:46.284968+0000","last_undegraded":"2024-09-11T01:11:46.284968+0000","last_fullsized":"2024-09-11T01:11:46.284968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175684+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T01:12:32.175684+0000","last_peered":"2024-09-11T01:12:32.175684+0000","last_clean":"2024-09-11T01:12:32.175684+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:32.175684+0000","last_undegraded":"2024-09-11T01:12:32.175684+0000","last_fullsized":"2024-09-11T01:12:32.175684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.313491+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T01:12:30.313491+0000","last_peered":"2024-09-11T01:12:30.313491+0000","last_clean":"2024-09-11T01:12:30.313491+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:30.313491+0000","last_undegraded":"2024-09-11T01:12:30.313491+0000","last_fullsized":"2024-09-11T01:12:30.313491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166331+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T01:12:32.166331+0000","last_peered":"2024-09-11T01:12:32.166331+0000","last_clean":"2024-09-11T01:12:32.166331+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:32.166331+0000","last_undegraded":"2024-09-11T01:12:32.166331+0000","last_fullsized":"2024-09-11T01:12:32.166331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1194","reported_seq":1233,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255776+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T01:12:30.255776+0000","last_peered":"2024-09-11T01:12:30.255776+0000","last_clean":"2024-09-11T01:12:30.255776+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:30.255776+0000","last_undegraded":"2024-09-11T01:12:30.255776+0000","last_fullsized":"2024-09-11T01:12:30.255776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.354736+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T01:12:30.354736+0000","last_peered":"2024-09-11T01:12:30.354736+0000","last_clean":"2024-09-11T01:12:30.354736+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:12:30.354736+0000","last_undegraded":"2024-09-11T01:12:30.354736+0000","last_fullsized":"2024-09-11T01:12:30.354736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.158944+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T01:12:32.158944+0000","last_peered":"2024-09-11T01:12:32.158944+0000","last_clean":"2024-09-11T01:12:32.158944+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:32.158944+0000","last_undegraded":"2024-09-11T01:12:32.158944+0000","last_fullsized":"2024-09-11T01:12:32.158944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216270+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T01:12:30.216270+0000","last_peered":"2024-09-11T01:12:30.216270+0000","last_clean":"2024-09-11T01:12:30.216270+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:30.216270+0000","last_undegraded":"2024-09-11T01:12:30.216270+0000","last_fullsized":"2024-09-11T01:12:30.216270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3746,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307169+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T01:12:30.307169+0000","last_peered":"2024-09-11T01:12:30.307169+0000","last_clean":"2024-09-11T01:12:30.307169+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:30.307169+0000","last_undegraded":"2024-09-11T01:12:30.307169+0000","last_fullsized":"2024-09-11T01:12:30.307169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.161667+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T01:12:32.161667+0000","last_peered":"2024-09-11T01:12:32.161667+0000","last_clean":"2024-09-11T01:12:32.161667+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:32.161667+0000","last_undegraded":"2024-09-11T01:12:32.161667+0000","last_fullsized":"2024-09-11T01:12:32.161667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.187936+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T01:12:30.187936+0000","last_peered":"2024-09-11T01:12:30.187936+0000","last_clean":"2024-09-11T01:12:30.187936+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:30.187936+0000","last_undegraded":"2024-09-11T01:12:30.187936+0000","last_fullsized":"2024-09-11T01:12:30.187936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201648+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T01:12:30.201648+0000","last_peered":"2024-09-11T01:12:30.201648+0000","last_clean":"2024-09-11T01:12:30.201648+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:30.201648+0000","last_undegraded":"2024-09-11T01:12:30.201648+0000","last_fullsized":"2024-09-11T01:12:30.201648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.130360+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T01:12:32.130360+0000","last_peered":"2024-09-11T01:12:32.130360+0000","last_clean":"2024-09-11T01:12:32.130360+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:32.130360+0000","last_undegraded":"2024-09-11T01:12:32.130360+0000","last_fullsized":"2024-09-11T01:12:32.130360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:28.875120+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T01:12:28.875120+0000","last_peered":"2024-09-11T01:12:28.875120+0000","last_clean":"2024-09-11T01:12:28.875120+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:28.875120+0000","last_undegraded":"2024-09-11T01:12:28.875120+0000","last_fullsized":"2024-09-11T01:12:28.875120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255530+0000","last_change":"2024-09-11T00:44:57.846986+0000","last_active":"2024-09-11T01:12:30.255530+0000","last_peered":"2024-09-11T01:12:30.255530+0000","last_clean":"2024-09-11T01:12:30.255530+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:30.255530+0000","last_undegraded":"2024-09-11T01:12:30.255530+0000","last_fullsized":"2024-09-11T01:12:30.255530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:48.733442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170735+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T01:12:32.170735+0000","last_peered":"2024-09-11T01:12:32.170735+0000","last_clean":"2024-09-11T01:12:32.170735+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:32.170735+0000","last_undegraded":"2024-09-11T01:12:32.170735+0000","last_fullsized":"2024-09-11T01:12:32.170735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.250636+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T01:12:30.250636+0000","last_peered":"2024-09-11T01:12:30.250636+0000","last_clean":"2024-09-11T01:12:30.250636+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:30.250636+0000","last_undegraded":"2024-09-11T01:12:30.250636+0000","last_fullsized":"2024-09-11T01:12:30.250636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.063655+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T01:12:30.063655+0000","last_peered":"2024-09-11T01:12:30.063655+0000","last_clean":"2024-09-11T01:12:30.063655+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:30.063655+0000","last_undegraded":"2024-09-11T01:12:30.063655+0000","last_fullsized":"2024-09-11T01:12:30.063655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167346+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T01:12:32.167346+0000","last_peered":"2024-09-11T01:12:32.167346+0000","last_clean":"2024-09-11T01:12:32.167346+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:32.167346+0000","last_undegraded":"2024-09-11T01:12:32.167346+0000","last_fullsized":"2024-09-11T01:12:32.167346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.834664+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T01:12:31.834664+0000","last_peered":"2024-09-11T01:12:31.834664+0000","last_clean":"2024-09-11T01:12:31.834664+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:31.834664+0000","last_undegraded":"2024-09-11T01:12:31.834664+0000","last_fullsized":"2024-09-11T01:12:31.834664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.297988+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T01:12:30.297988+0000","last_peered":"2024-09-11T01:12:30.297988+0000","last_clean":"2024-09-11T01:12:30.297988+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:30.297988+0000","last_undegraded":"2024-09-11T01:12:30.297988+0000","last_fullsized":"2024-09-11T01:12:30.297988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.163013+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T01:12:32.163013+0000","last_peered":"2024-09-11T01:12:32.163013+0000","last_clean":"2024-09-11T01:12:32.163013+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:32.163013+0000","last_undegraded":"2024-09-11T01:12:32.163013+0000","last_fullsized":"2024-09-11T01:12:32.163013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.185446+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T01:12:30.185446+0000","last_peered":"2024-09-11T01:12:30.185446+0000","last_clean":"2024-09-11T01:12:30.185446+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:30.185446+0000","last_undegraded":"2024-09-11T01:12:30.185446+0000","last_fullsized":"2024-09-11T01:12:30.185446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.300655+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T01:12:30.300655+0000","last_peered":"2024-09-11T01:12:30.300655+0000","last_clean":"2024-09-11T01:12:30.300655+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:30.300655+0000","last_undegraded":"2024-09-11T01:12:30.300655+0000","last_fullsized":"2024-09-11T01:12:30.300655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174302+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T01:12:32.174302+0000","last_peered":"2024-09-11T01:12:32.174302+0000","last_clean":"2024-09-11T01:12:32.174302+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:32.174302+0000","last_undegraded":"2024-09-11T01:12:32.174302+0000","last_fullsized":"2024-09-11T01:12:32.174302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.272321+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T01:12:30.272321+0000","last_peered":"2024-09-11T01:12:30.272321+0000","last_clean":"2024-09-11T01:12:30.272321+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:30.272321+0000","last_undegraded":"2024-09-11T01:12:30.272321+0000","last_fullsized":"2024-09-11T01:12:30.272321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4028,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216415+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T01:12:30.216415+0000","last_peered":"2024-09-11T01:12:30.216415+0000","last_clean":"2024-09-11T01:12:30.216415+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:30.216415+0000","last_undegraded":"2024-09-11T01:12:30.216415+0000","last_fullsized":"2024-09-11T01:12:30.216415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173660+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T01:12:32.173660+0000","last_peered":"2024-09-11T01:12:32.173660+0000","last_clean":"2024-09-11T01:12:32.173660+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:32.173660+0000","last_undegraded":"2024-09-11T01:12:32.173660+0000","last_fullsized":"2024-09-11T01:12:32.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.246446+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T01:12:30.246446+0000","last_peered":"2024-09-11T01:12:30.246446+0000","last_clean":"2024-09-11T01:12:30.246446+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:30.246446+0000","last_undegraded":"2024-09-11T01:12:30.246446+0000","last_fullsized":"2024-09-11T01:12:30.246446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.312745+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T01:12:30.312745+0000","last_peered":"2024-09-11T01:12:30.312745+0000","last_clean":"2024-09-11T01:12:30.312745+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:30.312745+0000","last_undegraded":"2024-09-11T01:12:30.312745+0000","last_fullsized":"2024-09-11T01:12:30.312745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176246+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T01:12:32.176246+0000","last_peered":"2024-09-11T01:12:32.176246+0000","last_clean":"2024-09-11T01:12:32.176246+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:32.176246+0000","last_undegraded":"2024-09-11T01:12:32.176246+0000","last_fullsized":"2024-09-11T01:12:32.176246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.860216+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T01:12:32.860216+0000","last_peered":"2024-09-11T01:12:32.860216+0000","last_clean":"2024-09-11T01:12:32.860216+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:32.860216+0000","last_undegraded":"2024-09-11T01:12:32.860216+0000","last_fullsized":"2024-09-11T01:12:32.860216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345927+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T01:12:30.345927+0000","last_peered":"2024-09-11T01:12:30.345927+0000","last_clean":"2024-09-11T01:12:30.345927+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:12:30.345927+0000","last_undegraded":"2024-09-11T01:12:30.345927+0000","last_fullsized":"2024-09-11T01:12:30.345927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.160741+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T01:12:32.160741+0000","last_peered":"2024-09-11T01:12:32.160741+0000","last_clean":"2024-09-11T01:12:32.160741+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:32.160741+0000","last_undegraded":"2024-09-11T01:12:32.160741+0000","last_fullsized":"2024-09-11T01:12:32.160741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.287905+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T01:12:30.287905+0000","last_peered":"2024-09-11T01:12:30.287905+0000","last_clean":"2024-09-11T01:12:30.287905+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:30.287905+0000","last_undegraded":"2024-09-11T01:12:30.287905+0000","last_fullsized":"2024-09-11T01:12:30.287905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.167008+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T01:12:30.167008+0000","last_peered":"2024-09-11T01:12:30.167008+0000","last_clean":"2024-09-11T01:12:30.167008+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:12:30.167008+0000","last_undegraded":"2024-09-11T01:12:30.167008+0000","last_fullsized":"2024-09-11T01:12:30.167008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176022+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T01:12:32.176022+0000","last_peered":"2024-09-11T01:12:32.176022+0000","last_clean":"2024-09-11T01:12:32.176022+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:32.176022+0000","last_undegraded":"2024-09-11T01:12:32.176022+0000","last_fullsized":"2024-09-11T01:12:32.176022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:09:14.875043+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T01:09:14.875043+0000","last_peered":"2024-09-11T01:09:14.875043+0000","last_clean":"2024-09-11T01:09:14.875043+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:09:14.875043+0000","last_undegraded":"2024-09-11T01:09:14.875043+0000","last_fullsized":"2024-09-11T01:09:14.875043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:12.301491+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T01:10:12.301491+0000","last_peered":"2024-09-11T01:10:12.301491+0000","last_clean":"2024-09-11T01:10:12.301491+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:10:12.301491+0000","last_undegraded":"2024-09-11T01:10:12.301491+0000","last_fullsized":"2024-09-11T01:10:12.301491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3469,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.218838+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T01:12:30.218838+0000","last_peered":"2024-09-11T01:12:30.218838+0000","last_clean":"2024-09-11T01:12:30.218838+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:12:30.218838+0000","last_undegraded":"2024-09-11T01:12:30.218838+0000","last_fullsized":"2024-09-11T01:12:30.218838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166643+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T01:12:32.166643+0000","last_peered":"2024-09-11T01:12:32.166643+0000","last_clean":"2024-09-11T01:12:32.166643+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:32.166643+0000","last_undegraded":"2024-09-11T01:12:32.166643+0000","last_fullsized":"2024-09-11T01:12:32.166643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:18.897991+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T01:11:18.897991+0000","last_peered":"2024-09-11T01:11:18.897991+0000","last_clean":"2024-09-11T01:11:18.897991+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:11:18.897991+0000","last_undegraded":"2024-09-11T01:11:18.897991+0000","last_fullsized":"2024-09-11T01:11:18.897991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3631,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307081+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T01:12:30.307081+0000","last_peered":"2024-09-11T01:12:30.307081+0000","last_clean":"2024-09-11T01:12:30.307081+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:30.307081+0000","last_undegraded":"2024-09-11T01:12:30.307081+0000","last_fullsized":"2024-09-11T01:12:30.307081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173027+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T01:12:32.173027+0000","last_peered":"2024-09-11T01:12:32.173027+0000","last_clean":"2024-09-11T01:12:32.173027+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:32.173027+0000","last_undegraded":"2024-09-11T01:12:32.173027+0000","last_fullsized":"2024-09-11T01:12:32.173027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:17.487776+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T01:11:17.487776+0000","last_peered":"2024-09-11T01:11:17.487776+0000","last_clean":"2024-09-11T01:11:17.487776+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:11:17.487776+0000","last_undegraded":"2024-09-11T01:11:17.487776+0000","last_fullsized":"2024-09-11T01:11:17.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3590,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.322566+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T01:12:30.322566+0000","last_peered":"2024-09-11T01:12:30.322566+0000","last_clean":"2024-09-11T01:12:30.322566+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:12:30.322566+0000","last_undegraded":"2024-09-11T01:12:30.322566+0000","last_fullsized":"2024-09-11T01:12:30.322566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178797+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T01:12:32.178797+0000","last_peered":"2024-09-11T01:12:32.178797+0000","last_clean":"2024-09-11T01:12:32.178797+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:32.178797+0000","last_undegraded":"2024-09-11T01:12:32.178797+0000","last_fullsized":"2024-09-11T01:12:32.178797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.233378+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T01:12:30.233378+0000","last_peered":"2024-09-11T01:12:30.233378+0000","last_clean":"2024-09-11T01:12:30.233378+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:30.233378+0000","last_undegraded":"2024-09-11T01:12:30.233378+0000","last_fullsized":"2024-09-11T01:12:30.233378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.210070+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T01:12:30.210070+0000","last_peered":"2024-09-11T01:12:30.210070+0000","last_clean":"2024-09-11T01:12:30.210070+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:12:30.210070+0000","last_undegraded":"2024-09-11T01:12:30.210070+0000","last_fullsized":"2024-09-11T01:12:30.210070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.184097+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T01:12:32.184097+0000","last_peered":"2024-09-11T01:12:32.184097+0000","last_clean":"2024-09-11T01:12:32.184097+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:32.184097+0000","last_undegraded":"2024-09-11T01:12:32.184097+0000","last_fullsized":"2024-09-11T01:12:32.184097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298932+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T01:12:30.298932+0000","last_peered":"2024-09-11T01:12:30.298932+0000","last_clean":"2024-09-11T01:12:30.298932+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:30.298932+0000","last_undegraded":"2024-09-11T01:12:30.298932+0000","last_fullsized":"2024-09-11T01:12:30.298932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3473,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.353343+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T01:12:30.353343+0000","last_peered":"2024-09-11T01:12:30.353343+0000","last_clean":"2024-09-11T01:12:30.353343+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:30.353343+0000","last_undegraded":"2024-09-11T01:12:30.353343+0000","last_fullsized":"2024-09-11T01:12:30.353343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170446+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T01:12:32.170446+0000","last_peered":"2024-09-11T01:12:32.170446+0000","last_clean":"2024-09-11T01:12:32.170446+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:32.170446+0000","last_undegraded":"2024-09-11T01:12:32.170446+0000","last_fullsized":"2024-09-11T01:12:32.170446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.257538+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T01:12:30.257538+0000","last_peered":"2024-09-11T01:12:30.257538+0000","last_clean":"2024-09-11T01:12:30.257538+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:30.257538+0000","last_undegraded":"2024-09-11T01:12:30.257538+0000","last_fullsized":"2024-09-11T01:12:30.257538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267004+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T01:12:30.267004+0000","last_peered":"2024-09-11T01:12:30.267004+0000","last_clean":"2024-09-11T01:12:30.267004+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:12:30.267004+0000","last_undegraded":"2024-09-11T01:12:30.267004+0000","last_fullsized":"2024-09-11T01:12:30.267004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.165269+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T01:12:32.165269+0000","last_peered":"2024-09-11T01:12:32.165269+0000","last_clean":"2024-09-11T01:12:32.165269+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:32.165269+0000","last_undegraded":"2024-09-11T01:12:32.165269+0000","last_fullsized":"2024-09-11T01:12:32.165269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.244504+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T01:12:30.244504+0000","last_peered":"2024-09-11T01:12:30.244504+0000","last_clean":"2024-09-11T01:12:30.244504+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:30.244504+0000","last_undegraded":"2024-09-11T01:12:30.244504+0000","last_fullsized":"2024-09-11T01:12:30.244504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.318719+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T01:12:30.318719+0000","last_peered":"2024-09-11T01:12:30.318719+0000","last_clean":"2024-09-11T01:12:30.318719+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:12:30.318719+0000","last_undegraded":"2024-09-11T01:12:30.318719+0000","last_fullsized":"2024-09-11T01:12:30.318719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174988+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T01:12:32.174988+0000","last_peered":"2024-09-11T01:12:32.174988+0000","last_clean":"2024-09-11T01:12:32.174988+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:32.174988+0000","last_undegraded":"2024-09-11T01:12:32.174988+0000","last_fullsized":"2024-09-11T01:12:32.174988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.180576+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T01:12:30.180576+0000","last_peered":"2024-09-11T01:12:30.180576+0000","last_clean":"2024-09-11T01:12:30.180576+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:30.180576+0000","last_undegraded":"2024-09-11T01:12:30.180576+0000","last_fullsized":"2024-09-11T01:12:30.180576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.348920+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T01:12:30.348920+0000","last_peered":"2024-09-11T01:12:30.348920+0000","last_clean":"2024-09-11T01:12:30.348920+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:30.348920+0000","last_undegraded":"2024-09-11T01:12:30.348920+0000","last_fullsized":"2024-09-11T01:12:30.348920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164904+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T01:12:32.164904+0000","last_peered":"2024-09-11T01:12:32.164904+0000","last_clean":"2024-09-11T01:12:32.164904+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:32.164904+0000","last_undegraded":"2024-09-11T01:12:32.164904+0000","last_fullsized":"2024-09-11T01:12:32.164904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256368+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T01:12:30.256368+0000","last_peered":"2024-09-11T01:12:30.256368+0000","last_clean":"2024-09-11T01:12:30.256368+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:30.256368+0000","last_undegraded":"2024-09-11T01:12:30.256368+0000","last_fullsized":"2024-09-11T01:12:30.256368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3514,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.053069+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T01:12:30.053069+0000","last_peered":"2024-09-11T01:12:30.053069+0000","last_clean":"2024-09-11T01:12:30.053069+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:12:30.053069+0000","last_undegraded":"2024-09-11T01:12:30.053069+0000","last_fullsized":"2024-09-11T01:12:30.053069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172462+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T01:12:32.172462+0000","last_peered":"2024-09-11T01:12:32.172462+0000","last_clean":"2024-09-11T01:12:32.172462+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:32.172462+0000","last_undegraded":"2024-09-11T01:12:32.172462+0000","last_fullsized":"2024-09-11T01:12:32.172462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'367","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.252206+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T01:12:30.252206+0000","last_peered":"2024-09-11T01:12:30.252206+0000","last_clean":"2024-09-11T01:12:30.252206+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:30.252206+0000","last_undegraded":"2024-09-11T01:12:30.252206+0000","last_fullsized":"2024-09-11T01:12:30.252206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3580,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.134688+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T01:12:30.134688+0000","last_peered":"2024-09-11T01:12:30.134688+0000","last_clean":"2024-09-11T01:12:30.134688+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:30.134688+0000","last_undegraded":"2024-09-11T01:12:30.134688+0000","last_fullsized":"2024-09-11T01:12:30.134688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178305+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T01:12:32.178305+0000","last_peered":"2024-09-11T01:12:32.178305+0000","last_clean":"2024-09-11T01:12:32.178305+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:32.178305+0000","last_undegraded":"2024-09-11T01:12:32.178305+0000","last_fullsized":"2024-09-11T01:12:32.178305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.863603+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T01:12:31.863603+0000","last_peered":"2024-09-11T01:12:31.863603+0000","last_clean":"2024-09-11T01:12:31.863603+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:31.863603+0000","last_undegraded":"2024-09-11T01:12:31.863603+0000","last_fullsized":"2024-09-11T01:12:31.863603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3760,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345509+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T01:12:30.345509+0000","last_peered":"2024-09-11T01:12:30.345509+0000","last_clean":"2024-09-11T01:12:30.345509+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:30.345509+0000","last_undegraded":"2024-09-11T01:12:30.345509+0000","last_fullsized":"2024-09-11T01:12:30.345509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177439+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T01:12:32.177439+0000","last_peered":"2024-09-11T01:12:32.177439+0000","last_clean":"2024-09-11T01:12:32.177439+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:32.177439+0000","last_undegraded":"2024-09-11T01:12:32.177439+0000","last_fullsized":"2024-09-11T01:12:32.177439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.145668+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T01:12:30.145668+0000","last_peered":"2024-09-11T01:12:30.145668+0000","last_clean":"2024-09-11T01:12:30.145668+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:30.145668+0000","last_undegraded":"2024-09-11T01:12:30.145668+0000","last_fullsized":"2024-09-11T01:12:30.145668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201774+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T01:12:30.201774+0000","last_peered":"2024-09-11T01:12:30.201774+0000","last_clean":"2024-09-11T01:12:30.201774+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:30.201774+0000","last_undegraded":"2024-09-11T01:12:30.201774+0000","last_fullsized":"2024-09-11T01:12:30.201774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183382+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T01:12:32.183382+0000","last_peered":"2024-09-11T01:12:32.183382+0000","last_clean":"2024-09-11T01:12:32.183382+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:32.183382+0000","last_undegraded":"2024-09-11T01:12:32.183382+0000","last_fullsized":"2024-09-11T01:12:32.183382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.251283+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T01:10:53.251283+0000","last_peered":"2024-09-11T01:10:53.251283+0000","last_clean":"2024-09-11T01:10:53.251283+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:10:53.251283+0000","last_undegraded":"2024-09-11T01:10:53.251283+0000","last_fullsized":"2024-09-11T01:10:53.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4011,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.293685+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T01:12:30.293685+0000","last_peered":"2024-09-11T01:12:30.293685+0000","last_clean":"2024-09-11T01:12:30.293685+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:30.293685+0000","last_undegraded":"2024-09-11T01:12:30.293685+0000","last_fullsized":"2024-09-11T01:12:30.293685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.341995+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T01:12:30.341995+0000","last_peered":"2024-09-11T01:12:30.341995+0000","last_clean":"2024-09-11T01:12:30.341995+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:12:30.341995+0000","last_undegraded":"2024-09-11T01:12:30.341995+0000","last_fullsized":"2024-09-11T01:12:30.341995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174011+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T01:12:32.174011+0000","last_peered":"2024-09-11T01:12:32.174011+0000","last_clean":"2024-09-11T01:12:32.174011+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:32.174011+0000","last_undegraded":"2024-09-11T01:12:32.174011+0000","last_fullsized":"2024-09-11T01:12:32.174011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:29.280855+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T01:12:29.280855+0000","last_peered":"2024-09-11T01:12:29.280855+0000","last_clean":"2024-09-11T01:12:29.280855+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:29.280855+0000","last_undegraded":"2024-09-11T01:12:29.280855+0000","last_fullsized":"2024-09-11T01:12:29.280855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.279045+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T01:12:30.279045+0000","last_peered":"2024-09-11T01:12:30.279045+0000","last_clean":"2024-09-11T01:12:30.279045+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:12:30.279045+0000","last_undegraded":"2024-09-11T01:12:30.279045+0000","last_fullsized":"2024-09-11T01:12:30.279045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176842+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T01:12:32.176842+0000","last_peered":"2024-09-11T01:12:32.176842+0000","last_clean":"2024-09-11T01:12:32.176842+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:32.176842+0000","last_undegraded":"2024-09-11T01:12:32.176842+0000","last_fullsized":"2024-09-11T01:12:32.176842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.182691+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T01:10:53.182691+0000","last_peered":"2024-09-11T01:10:53.182691+0000","last_clean":"2024-09-11T01:10:53.182691+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:10:53.182691+0000","last_undegraded":"2024-09-11T01:10:53.182691+0000","last_fullsized":"2024-09-11T01:10:53.182691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267800+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T01:12:30.267800+0000","last_peered":"2024-09-11T01:12:30.267800+0000","last_clean":"2024-09-11T01:12:30.267800+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:30.267800+0000","last_undegraded":"2024-09-11T01:12:30.267800+0000","last_fullsized":"2024-09-11T01:12:30.267800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177191+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T01:12:32.177191+0000","last_peered":"2024-09-11T01:12:32.177191+0000","last_clean":"2024-09-11T01:12:32.177191+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:32.177191+0000","last_undegraded":"2024-09-11T01:12:32.177191+0000","last_fullsized":"2024-09-11T01:12:32.177191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3060,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.022723+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T01:12:30.022723+0000","last_peered":"2024-09-11T01:12:30.022723+0000","last_clean":"2024-09-11T01:12:30.022723+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:30.022723+0000","last_undegraded":"2024-09-11T01:12:30.022723+0000","last_fullsized":"2024-09-11T01:12:30.022723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'608","reported_seq":646,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:47.550566+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T01:11:47.550566+0000","last_peered":"2024-09-11T01:11:47.550566+0000","last_clean":"2024-09-11T01:11:47.550566+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:11:47.550566+0000","last_undegraded":"2024-09-11T01:11:47.550566+0000","last_fullsized":"2024-09-11T01:11:47.550566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180166+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T01:12:32.180166+0000","last_peered":"2024-09-11T01:12:32.180166+0000","last_clean":"2024-09-11T01:12:32.180166+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:32.180166+0000","last_undegraded":"2024-09-11T01:12:32.180166+0000","last_fullsized":"2024-09-11T01:12:32.180166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298969+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T01:12:30.298969+0000","last_peered":"2024-09-11T01:12:30.298969+0000","last_clean":"2024-09-11T01:12:30.298969+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:30.298969+0000","last_undegraded":"2024-09-11T01:12:30.298969+0000","last_fullsized":"2024-09-11T01:12:30.298969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167609+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T01:12:32.167609+0000","last_peered":"2024-09-11T01:12:32.167609+0000","last_clean":"2024-09-11T01:12:32.167609+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:32.167609+0000","last_undegraded":"2024-09-11T01:12:32.167609+0000","last_fullsized":"2024-09-11T01:12:32.167609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.159359+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T01:12:32.159359+0000","last_peered":"2024-09-11T01:12:32.159359+0000","last_clean":"2024-09-11T01:12:32.159359+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:32.159359+0000","last_undegraded":"2024-09-11T01:12:32.159359+0000","last_fullsized":"2024-09-11T01:12:32.159359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178354+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T01:12:32.178354+0000","last_peered":"2024-09-11T01:12:32.178354+0000","last_clean":"2024-09-11T01:12:32.178354+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:32.178354+0000","last_undegraded":"2024-09-11T01:12:32.178354+0000","last_fullsized":"2024-09-11T01:12:32.178354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175700+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T01:12:32.175700+0000","last_peered":"2024-09-11T01:12:32.175700+0000","last_clean":"2024-09-11T01:12:32.175700+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:32.175700+0000","last_undegraded":"2024-09-11T01:12:32.175700+0000","last_fullsized":"2024-09-11T01:12:32.175700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177831+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T01:12:32.177831+0000","last_peered":"2024-09-11T01:12:32.177831+0000","last_clean":"2024-09-11T01:12:32.177831+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:32.177831+0000","last_undegraded":"2024-09-11T01:12:32.177831+0000","last_fullsized":"2024-09-11T01:12:32.177831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.152165+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T01:12:32.152165+0000","last_peered":"2024-09-11T01:12:32.152165+0000","last_clean":"2024-09-11T01:12:32.152165+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:32.152165+0000","last_undegraded":"2024-09-11T01:12:32.152165+0000","last_fullsized":"2024-09-11T01:12:32.152165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183309+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T01:12:32.183309+0000","last_peered":"2024-09-11T01:12:32.183309+0000","last_clean":"2024-09-11T01:12:32.183309+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:32.183309+0000","last_undegraded":"2024-09-11T01:12:32.183309+0000","last_fullsized":"2024-09-11T01:12:32.183309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175313+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T01:12:32.175313+0000","last_peered":"2024-09-11T01:12:32.175313+0000","last_clean":"2024-09-11T01:12:32.175313+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:32.175313+0000","last_undegraded":"2024-09-11T01:12:32.175313+0000","last_fullsized":"2024-09-11T01:12:32.175313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178446+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T01:12:32.178446+0000","last_peered":"2024-09-11T01:12:32.178446+0000","last_clean":"2024-09-11T01:12:32.178446+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:12:32.178446+0000","last_undegraded":"2024-09-11T01:12:32.178446+0000","last_fullsized":"2024-09-11T01:12:32.178446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.179104+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T01:12:32.179104+0000","last_peered":"2024-09-11T01:12:32.179104+0000","last_clean":"2024-09-11T01:12:32.179104+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:32.179104+0000","last_undegraded":"2024-09-11T01:12:32.179104+0000","last_fullsized":"2024-09-11T01:12:32.179104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170124+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T01:12:32.170124+0000","last_peered":"2024-09-11T01:12:32.170124+0000","last_clean":"2024-09-11T01:12:32.170124+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:32.170124+0000","last_undegraded":"2024-09-11T01:12:32.170124+0000","last_fullsized":"2024-09-11T01:12:32.170124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180410+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T01:12:32.180410+0000","last_peered":"2024-09-11T01:12:32.180410+0000","last_clean":"2024-09-11T01:12:32.180410+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:32.180410+0000","last_undegraded":"2024-09-11T01:12:32.180410+0000","last_fullsized":"2024-09-11T01:12:32.180410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177471+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T01:12:32.177471+0000","last_peered":"2024-09-11T01:12:32.177471+0000","last_clean":"2024-09-11T01:12:32.177471+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:32.177471+0000","last_undegraded":"2024-09-11T01:12:32.177471+0000","last_fullsized":"2024-09-11T01:12:32.177471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169364+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T01:12:32.169364+0000","last_peered":"2024-09-11T01:12:32.169364+0000","last_clean":"2024-09-11T01:12:32.169364+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:12:32.169364+0000","last_undegraded":"2024-09-11T01:12:32.169364+0000","last_fullsized":"2024-09-11T01:12:32.169364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.168873+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T01:12:32.168873+0000","last_peered":"2024-09-11T01:12:32.168873+0000","last_clean":"2024-09-11T01:12:32.168873+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:32.168873+0000","last_undegraded":"2024-09-11T01:12:32.168873+0000","last_fullsized":"2024-09-11T01:12:32.168873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174517+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T01:12:32.174517+0000","last_peered":"2024-09-11T01:12:32.174517+0000","last_clean":"2024-09-11T01:12:32.174517+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:12:32.174517+0000","last_undegraded":"2024-09-11T01:12:32.174517+0000","last_fullsized":"2024-09-11T01:12:32.174517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.171124+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T01:12:32.171124+0000","last_peered":"2024-09-11T01:12:32.171124+0000","last_clean":"2024-09-11T01:12:32.171124+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:12:32.171124+0000","last_undegraded":"2024-09-11T01:12:32.171124+0000","last_fullsized":"2024-09-11T01:12:32.171124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175872+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T01:12:32.175872+0000","last_peered":"2024-09-11T01:12:32.175872+0000","last_clean":"2024-09-11T01:12:32.175872+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:32.175872+0000","last_undegraded":"2024-09-11T01:12:32.175872+0000","last_fullsized":"2024-09-11T01:12:32.175872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.155284+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T01:12:32.155284+0000","last_peered":"2024-09-11T01:12:32.155284+0000","last_clean":"2024-09-11T01:12:32.155284+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:32.155284+0000","last_undegraded":"2024-09-11T01:12:32.155284+0000","last_fullsized":"2024-09-11T01:12:32.155284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169520+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T01:12:32.169520+0000","last_peered":"2024-09-11T01:12:32.169520+0000","last_clean":"2024-09-11T01:12:32.169520+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:32.169520+0000","last_undegraded":"2024-09-11T01:12:32.169520+0000","last_fullsized":"2024-09-11T01:12:32.169520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180898+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T01:12:32.180898+0000","last_peered":"2024-09-11T01:12:32.180898+0000","last_clean":"2024-09-11T01:12:32.180898+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:32.180898+0000","last_undegraded":"2024-09-11T01:12:32.180898+0000","last_fullsized":"2024-09-11T01:12:32.180898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172147+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T01:12:32.172147+0000","last_peered":"2024-09-11T01:12:32.172147+0000","last_clean":"2024-09-11T01:12:32.172147+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:32.172147+0000","last_undegraded":"2024-09-11T01:12:32.172147+0000","last_fullsized":"2024-09-11T01:12:32.172147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181309+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T01:12:32.181309+0000","last_peered":"2024-09-11T01:12:32.181309+0000","last_clean":"2024-09-11T01:12:32.181309+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:32.181309+0000","last_undegraded":"2024-09-11T01:12:32.181309+0000","last_fullsized":"2024-09-11T01:12:32.181309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166759+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T01:12:32.166759+0000","last_peered":"2024-09-11T01:12:32.166759+0000","last_clean":"2024-09-11T01:12:32.166759+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:32.166759+0000","last_undegraded":"2024-09-11T01:12:32.166759+0000","last_fullsized":"2024-09-11T01:12:32.166759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180470+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T01:12:32.180470+0000","last_peered":"2024-09-11T01:12:32.180470+0000","last_clean":"2024-09-11T01:12:32.180470+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:32.180470+0000","last_undegraded":"2024-09-11T01:12:32.180470+0000","last_fullsized":"2024-09-11T01:12:32.180470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164129+0000","last_change":"2024-09-11T00:44:57.516134+0000","last_active":"2024-09-11T01:12:32.164129+0000","last_peered":"2024-09-11T01:12:32.164129+0000","last_clean":"2024-09-11T01:12:32.164129+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:32.164129+0000","last_undegraded":"2024-09-11T01:12:32.164129+0000","last_fullsized":"2024-09-11T01:12:32.164129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175616+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T01:12:32.175616+0000","last_peered":"2024-09-11T01:12:32.175616+0000","last_clean":"2024-09-11T01:12:32.175616+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:32.175616+0000","last_undegraded":"2024-09-11T01:12:32.175616+0000","last_fullsized":"2024-09-11T01:12:32.175616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177037+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T01:12:32.177037+0000","last_peered":"2024-09-11T01:12:32.177037+0000","last_clean":"2024-09-11T01:12:32.177037+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:32.177037+0000","last_undegraded":"2024-09-11T01:12:32.177037+0000","last_fullsized":"2024-09-11T01:12:32.177037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177662+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T01:12:32.177662+0000","last_peered":"2024-09-11T01:12:32.177662+0000","last_clean":"2024-09-11T01:12:32.177662+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:32.177662+0000","last_undegraded":"2024-09-11T01:12:32.177662+0000","last_fullsized":"2024-09-11T01:12:32.177662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175993+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T01:12:32.175993+0000","last_peered":"2024-09-11T01:12:32.175993+0000","last_clean":"2024-09-11T01:12:32.175993+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:32.175993+0000","last_undegraded":"2024-09-11T01:12:32.175993+0000","last_fullsized":"2024-09-11T01:12:32.175993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166210+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T01:12:32.166210+0000","last_peered":"2024-09-11T01:12:32.166210+0000","last_clean":"2024-09-11T01:12:32.166210+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:32.166210+0000","last_undegraded":"2024-09-11T01:12:32.166210+0000","last_fullsized":"2024-09-11T01:12:32.166210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173362+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T01:12:32.173362+0000","last_peered":"2024-09-11T01:12:32.173362+0000","last_clean":"2024-09-11T01:12:32.173362+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:32.173362+0000","last_undegraded":"2024-09-11T01:12:32.173362+0000","last_fullsized":"2024-09-11T01:12:32.173362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15867448,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3777,"num_write_kb":16855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31734896,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3296,"ondisk_log_size":3296,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509783,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7507902,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574232,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93797608,"statfs":{"total":96636764160,"available":96048750592,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509783,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509784,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7508664,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7383683,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7384445,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:12:39.520 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T01:12:39.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:12:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 -- 172.21.15.81:0/3963859407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f00b1f10 msgr2=0x7f10f00745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 --2- 172.21.15.81:0/3963859407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f00b1f10 0x7f10f00745f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f10f00c9760 tx=0x7f10dc02a560 comp rx=0 tx=0).stop 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 -- 172.21.15.81:0/3963859407 shutdown_connections 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 --2- 172.21.15.81:0/3963859407 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f0074b30 0x7f10f015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 --2- 172.21.15.81:0/3963859407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f00b1f10 0x7f10f00745f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 --2- 172.21.15.81:0/3963859407 >> v2:172.21.15.167:3300/0 conn(0x7f10f014ebc0 0x7f10f006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.711+0000 7f10f5e00640 1 -- 172.21.15.81:0/3963859407 >> 172.21.15.81:0/3963859407 conn(0x7f10f006ffd0 msgr2=0x7f10f00703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.712+0000 7f10f5e00640 1 -- 172.21.15.81:0/3963859407 shutdown_connections 2024-09-11T01:12:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.712+0000 7f10f5e00640 1 -- 172.21.15.81:0/3963859407 wait complete. 2024-09-11T01:12:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.713+0000 7f10f5e00640 1 Processor -- start 2024-09-11T01:12:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.713+0000 7f10f5e00640 1 -- start start 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 0x7f10f01eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f014ebc0 0x7f10f01e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00c7040 con 0x7f10f0074b30 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10f01581a0 con 0x7f10f00b1f10 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f5e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f10f014efa0 con 0x7f10f014ebc0 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50898/0 (socket says 172.21.15.81:50898) 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.714+0000 7f10f4a00640 1 -- 172.21.15.81:0/2255694929 learned_addr learned my addr 172.21.15.81:0/2255694929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10efe00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 0x7f10f01eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f5400640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f014ebc0 0x7f10f01e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 -- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f014ebc0 msgr2=0x7f10f01e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f014ebc0 0x7f10f01e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 -- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 msgr2=0x7f10f01eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 0x7f10f01eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 -- 172.21.15.81:0/2255694929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00c9e40 con 0x7f10f0074b30 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10efe00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 0x7f10f01eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f4a00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f10e000cce0 tx=0x7f10e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e000f450 con 0x7f10f0074b30 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10e000f6e0 con 0x7f10f0074b30 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f00c9b60 con 0x7f10f0074b30 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.715+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e000fb30 con 0x7f10f0074b30 2024-09-11T01:12:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.716+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f014e390 con 0x7f10f0074b30 2024-09-11T01:12:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.717+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f00745f0 con 0x7f10f0074b30 2024-09-11T01:12:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.718+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f10e0020030 con 0x7f10f0074b30 2024-09-11T01:12:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.718+0000 7f10ecc00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 0x7f10d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.719+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f10e009a950 con 0x7f10f0074b30 2024-09-11T01:12:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.719+0000 7f10efe00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 0x7f10d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.720+0000 7f10efe00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 0x7f10d007a430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f10dc033000 tx=0x7f10dc004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.723+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f10e0014030 con 0x7f10f0074b30 2024-09-11T01:12:39.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.902+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10f014bb30 con 0x7f10d0077f70 2024-09-11T01:12:39.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.908+0000 7f10ecc00640 1 -- 172.21.15.81:0/2255694929 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334149 (secure 0 0 0) 0x7f10f014bb30 con 0x7f10d0077f70 2024-09-11T01:12:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:39.915 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:12:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.913+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 msgr2=0x7f10d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.913+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 0x7f10d007a430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f10dc033000 tx=0x7f10dc004730 comp rx=0 tx=0).stop 2024-09-11T01:12:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.913+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 msgr2=0x7f10f00caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.913+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f10e000cce0 tx=0x7f10e000a620 comp rx=0 tx=0).stop 2024-09-11T01:12:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 shutdown_connections 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f10d0077f70 0x7f10d007a430 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10f014ebc0 0x7f10f01e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10f00b1f10 0x7f10f01eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 --2- 172.21.15.81:0/2255694929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0074b30 0x7f10f00caaf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 >> 172.21.15.81:0/2255694929 conn(0x7f10f006ffd0 msgr2=0x7f10f015b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 shutdown_connections 2024-09-11T01:12:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:39.914+0000 7f10f5e00640 1 -- 172.21.15.81:0/2255694929 wait complete. 2024-09-11T01:12:39.931 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":880,"stamp":"2024-09-11T01:12:38.336549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16457816,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617527,"num_write_kb":15568565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122311,"ondisk_log_size":122311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5099712,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5076531,"kb_avail":749875008,"statfs":{"total":773094113280,"available":767872008192,"internally_reserved":0,"allocated":23592960,"data_stored":33909384,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5198368305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1679016204,"num_objects":-600,"num_object_clones":0,"num_object_copies":-2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-600,"num_whiteouts":0,"num_read":6,"num_read_kb":34,"num_write":710,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003776"},"pg_stats":[{"pgid":"2.1f","version":"29'455","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.186156+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T01:12:32.186156+0000","last_peered":"2024-09-11T01:12:32.186156+0000","last_clean":"2024-09-11T01:12:32.186156+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:32.186156+0000","last_undegraded":"2024-09-11T01:12:32.186156+0000","last_fullsized":"2024-09-11T01:12:32.186156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189379,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":3331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180955+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T01:12:32.180955+0000","last_peered":"2024-09-11T01:12:32.180955+0000","last_clean":"2024-09-11T01:12:32.180955+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:32.180955+0000","last_undegraded":"2024-09-11T01:12:32.180955+0000","last_fullsized":"2024-09-11T01:12:32.180955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4034,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.363576+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T01:12:30.363576+0000","last_peered":"2024-09-11T01:12:30.363576+0000","last_clean":"2024-09-11T01:12:30.363576+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:30.363576+0000","last_undegraded":"2024-09-11T01:12:30.363576+0000","last_fullsized":"2024-09-11T01:12:30.363576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256931+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T01:12:30.256931+0000","last_peered":"2024-09-11T01:12:30.256931+0000","last_clean":"2024-09-11T01:12:30.256931+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:30.256931+0000","last_undegraded":"2024-09-11T01:12:30.256931+0000","last_fullsized":"2024-09-11T01:12:30.256931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181533+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T01:12:32.181533+0000","last_peered":"2024-09-11T01:12:32.181533+0000","last_clean":"2024-09-11T01:12:32.181533+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:32.181533+0000","last_undegraded":"2024-09-11T01:12:32.181533+0000","last_fullsized":"2024-09-11T01:12:32.181533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.346355+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T01:12:30.346355+0000","last_peered":"2024-09-11T01:12:30.346355+0000","last_clean":"2024-09-11T01:12:30.346355+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:30.346355+0000","last_undegraded":"2024-09-11T01:12:30.346355+0000","last_fullsized":"2024-09-11T01:12:30.346355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.304546+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T01:12:30.304546+0000","last_peered":"2024-09-11T01:12:30.304546+0000","last_clean":"2024-09-11T01:12:30.304546+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:30.304546+0000","last_undegraded":"2024-09-11T01:12:30.304546+0000","last_fullsized":"2024-09-11T01:12:30.304546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180664+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T01:12:32.180664+0000","last_peered":"2024-09-11T01:12:32.180664+0000","last_clean":"2024-09-11T01:12:32.180664+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:32.180664+0000","last_undegraded":"2024-09-11T01:12:32.180664+0000","last_fullsized":"2024-09-11T01:12:32.180664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3815,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.340870+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T01:12:30.340870+0000","last_peered":"2024-09-11T01:12:30.340870+0000","last_clean":"2024-09-11T01:12:30.340870+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:30.340870+0000","last_undegraded":"2024-09-11T01:12:30.340870+0000","last_fullsized":"2024-09-11T01:12:30.340870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:46.284968+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T01:11:46.284968+0000","last_peered":"2024-09-11T01:11:46.284968+0000","last_clean":"2024-09-11T01:11:46.284968+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:11:46.284968+0000","last_undegraded":"2024-09-11T01:11:46.284968+0000","last_fullsized":"2024-09-11T01:11:46.284968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175684+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T01:12:32.175684+0000","last_peered":"2024-09-11T01:12:32.175684+0000","last_clean":"2024-09-11T01:12:32.175684+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:32.175684+0000","last_undegraded":"2024-09-11T01:12:32.175684+0000","last_fullsized":"2024-09-11T01:12:32.175684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.313491+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T01:12:30.313491+0000","last_peered":"2024-09-11T01:12:30.313491+0000","last_clean":"2024-09-11T01:12:30.313491+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:30.313491+0000","last_undegraded":"2024-09-11T01:12:30.313491+0000","last_fullsized":"2024-09-11T01:12:30.313491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166331+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T01:12:32.166331+0000","last_peered":"2024-09-11T01:12:32.166331+0000","last_clean":"2024-09-11T01:12:32.166331+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:32.166331+0000","last_undegraded":"2024-09-11T01:12:32.166331+0000","last_fullsized":"2024-09-11T01:12:32.166331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1194","reported_seq":1233,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255776+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T01:12:30.255776+0000","last_peered":"2024-09-11T01:12:30.255776+0000","last_clean":"2024-09-11T01:12:30.255776+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:30.255776+0000","last_undegraded":"2024-09-11T01:12:30.255776+0000","last_fullsized":"2024-09-11T01:12:30.255776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.354736+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T01:12:30.354736+0000","last_peered":"2024-09-11T01:12:30.354736+0000","last_clean":"2024-09-11T01:12:30.354736+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:12:30.354736+0000","last_undegraded":"2024-09-11T01:12:30.354736+0000","last_fullsized":"2024-09-11T01:12:30.354736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.158944+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T01:12:32.158944+0000","last_peered":"2024-09-11T01:12:32.158944+0000","last_clean":"2024-09-11T01:12:32.158944+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:32.158944+0000","last_undegraded":"2024-09-11T01:12:32.158944+0000","last_fullsized":"2024-09-11T01:12:32.158944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216270+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T01:12:30.216270+0000","last_peered":"2024-09-11T01:12:30.216270+0000","last_clean":"2024-09-11T01:12:30.216270+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:30.216270+0000","last_undegraded":"2024-09-11T01:12:30.216270+0000","last_fullsized":"2024-09-11T01:12:30.216270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3746,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307169+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T01:12:30.307169+0000","last_peered":"2024-09-11T01:12:30.307169+0000","last_clean":"2024-09-11T01:12:30.307169+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:30.307169+0000","last_undegraded":"2024-09-11T01:12:30.307169+0000","last_fullsized":"2024-09-11T01:12:30.307169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.161667+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T01:12:32.161667+0000","last_peered":"2024-09-11T01:12:32.161667+0000","last_clean":"2024-09-11T01:12:32.161667+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:32.161667+0000","last_undegraded":"2024-09-11T01:12:32.161667+0000","last_fullsized":"2024-09-11T01:12:32.161667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.187936+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T01:12:30.187936+0000","last_peered":"2024-09-11T01:12:30.187936+0000","last_clean":"2024-09-11T01:12:30.187936+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:30.187936+0000","last_undegraded":"2024-09-11T01:12:30.187936+0000","last_fullsized":"2024-09-11T01:12:30.187936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201648+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T01:12:30.201648+0000","last_peered":"2024-09-11T01:12:30.201648+0000","last_clean":"2024-09-11T01:12:30.201648+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:30.201648+0000","last_undegraded":"2024-09-11T01:12:30.201648+0000","last_fullsized":"2024-09-11T01:12:30.201648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.130360+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T01:12:32.130360+0000","last_peered":"2024-09-11T01:12:32.130360+0000","last_clean":"2024-09-11T01:12:32.130360+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:32.130360+0000","last_undegraded":"2024-09-11T01:12:32.130360+0000","last_fullsized":"2024-09-11T01:12:32.130360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:28.875120+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T01:12:28.875120+0000","last_peered":"2024-09-11T01:12:28.875120+0000","last_clean":"2024-09-11T01:12:28.875120+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:28.875120+0000","last_undegraded":"2024-09-11T01:12:28.875120+0000","last_fullsized":"2024-09-11T01:12:28.875120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255530+0000","last_change":"2024-09-11T00:44:57.846986+0000","last_active":"2024-09-11T01:12:30.255530+0000","last_peered":"2024-09-11T01:12:30.255530+0000","last_clean":"2024-09-11T01:12:30.255530+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:30.255530+0000","last_undegraded":"2024-09-11T01:12:30.255530+0000","last_fullsized":"2024-09-11T01:12:30.255530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:48.733442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170735+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T01:12:32.170735+0000","last_peered":"2024-09-11T01:12:32.170735+0000","last_clean":"2024-09-11T01:12:32.170735+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:32.170735+0000","last_undegraded":"2024-09-11T01:12:32.170735+0000","last_fullsized":"2024-09-11T01:12:32.170735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.250636+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T01:12:30.250636+0000","last_peered":"2024-09-11T01:12:30.250636+0000","last_clean":"2024-09-11T01:12:30.250636+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:30.250636+0000","last_undegraded":"2024-09-11T01:12:30.250636+0000","last_fullsized":"2024-09-11T01:12:30.250636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.063655+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T01:12:30.063655+0000","last_peered":"2024-09-11T01:12:30.063655+0000","last_clean":"2024-09-11T01:12:30.063655+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:30.063655+0000","last_undegraded":"2024-09-11T01:12:30.063655+0000","last_fullsized":"2024-09-11T01:12:30.063655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167346+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T01:12:32.167346+0000","last_peered":"2024-09-11T01:12:32.167346+0000","last_clean":"2024-09-11T01:12:32.167346+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:32.167346+0000","last_undegraded":"2024-09-11T01:12:32.167346+0000","last_fullsized":"2024-09-11T01:12:32.167346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.834664+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T01:12:31.834664+0000","last_peered":"2024-09-11T01:12:31.834664+0000","last_clean":"2024-09-11T01:12:31.834664+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:31.834664+0000","last_undegraded":"2024-09-11T01:12:31.834664+0000","last_fullsized":"2024-09-11T01:12:31.834664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.297988+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T01:12:30.297988+0000","last_peered":"2024-09-11T01:12:30.297988+0000","last_clean":"2024-09-11T01:12:30.297988+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:30.297988+0000","last_undegraded":"2024-09-11T01:12:30.297988+0000","last_fullsized":"2024-09-11T01:12:30.297988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.163013+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T01:12:32.163013+0000","last_peered":"2024-09-11T01:12:32.163013+0000","last_clean":"2024-09-11T01:12:32.163013+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:32.163013+0000","last_undegraded":"2024-09-11T01:12:32.163013+0000","last_fullsized":"2024-09-11T01:12:32.163013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.185446+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T01:12:30.185446+0000","last_peered":"2024-09-11T01:12:30.185446+0000","last_clean":"2024-09-11T01:12:30.185446+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:30.185446+0000","last_undegraded":"2024-09-11T01:12:30.185446+0000","last_fullsized":"2024-09-11T01:12:30.185446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.300655+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T01:12:30.300655+0000","last_peered":"2024-09-11T01:12:30.300655+0000","last_clean":"2024-09-11T01:12:30.300655+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:30.300655+0000","last_undegraded":"2024-09-11T01:12:30.300655+0000","last_fullsized":"2024-09-11T01:12:30.300655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174302+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T01:12:32.174302+0000","last_peered":"2024-09-11T01:12:32.174302+0000","last_clean":"2024-09-11T01:12:32.174302+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:32.174302+0000","last_undegraded":"2024-09-11T01:12:32.174302+0000","last_fullsized":"2024-09-11T01:12:32.174302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.272321+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T01:12:30.272321+0000","last_peered":"2024-09-11T01:12:30.272321+0000","last_clean":"2024-09-11T01:12:30.272321+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:30.272321+0000","last_undegraded":"2024-09-11T01:12:30.272321+0000","last_fullsized":"2024-09-11T01:12:30.272321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4028,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216415+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T01:12:30.216415+0000","last_peered":"2024-09-11T01:12:30.216415+0000","last_clean":"2024-09-11T01:12:30.216415+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:30.216415+0000","last_undegraded":"2024-09-11T01:12:30.216415+0000","last_fullsized":"2024-09-11T01:12:30.216415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173660+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T01:12:32.173660+0000","last_peered":"2024-09-11T01:12:32.173660+0000","last_clean":"2024-09-11T01:12:32.173660+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:32.173660+0000","last_undegraded":"2024-09-11T01:12:32.173660+0000","last_fullsized":"2024-09-11T01:12:32.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.246446+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T01:12:30.246446+0000","last_peered":"2024-09-11T01:12:30.246446+0000","last_clean":"2024-09-11T01:12:30.246446+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:30.246446+0000","last_undegraded":"2024-09-11T01:12:30.246446+0000","last_fullsized":"2024-09-11T01:12:30.246446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.312745+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T01:12:30.312745+0000","last_peered":"2024-09-11T01:12:30.312745+0000","last_clean":"2024-09-11T01:12:30.312745+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:30.312745+0000","last_undegraded":"2024-09-11T01:12:30.312745+0000","last_fullsized":"2024-09-11T01:12:30.312745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176246+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T01:12:32.176246+0000","last_peered":"2024-09-11T01:12:32.176246+0000","last_clean":"2024-09-11T01:12:32.176246+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:32.176246+0000","last_undegraded":"2024-09-11T01:12:32.176246+0000","last_fullsized":"2024-09-11T01:12:32.176246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.860216+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T01:12:32.860216+0000","last_peered":"2024-09-11T01:12:32.860216+0000","last_clean":"2024-09-11T01:12:32.860216+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:32.860216+0000","last_undegraded":"2024-09-11T01:12:32.860216+0000","last_fullsized":"2024-09-11T01:12:32.860216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345927+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T01:12:30.345927+0000","last_peered":"2024-09-11T01:12:30.345927+0000","last_clean":"2024-09-11T01:12:30.345927+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:12:30.345927+0000","last_undegraded":"2024-09-11T01:12:30.345927+0000","last_fullsized":"2024-09-11T01:12:30.345927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.160741+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T01:12:32.160741+0000","last_peered":"2024-09-11T01:12:32.160741+0000","last_clean":"2024-09-11T01:12:32.160741+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:32.160741+0000","last_undegraded":"2024-09-11T01:12:32.160741+0000","last_fullsized":"2024-09-11T01:12:32.160741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.287905+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T01:12:30.287905+0000","last_peered":"2024-09-11T01:12:30.287905+0000","last_clean":"2024-09-11T01:12:30.287905+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:30.287905+0000","last_undegraded":"2024-09-11T01:12:30.287905+0000","last_fullsized":"2024-09-11T01:12:30.287905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.167008+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T01:12:30.167008+0000","last_peered":"2024-09-11T01:12:30.167008+0000","last_clean":"2024-09-11T01:12:30.167008+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:12:30.167008+0000","last_undegraded":"2024-09-11T01:12:30.167008+0000","last_fullsized":"2024-09-11T01:12:30.167008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176022+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T01:12:32.176022+0000","last_peered":"2024-09-11T01:12:32.176022+0000","last_clean":"2024-09-11T01:12:32.176022+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:32.176022+0000","last_undegraded":"2024-09-11T01:12:32.176022+0000","last_fullsized":"2024-09-11T01:12:32.176022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:09:14.875043+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T01:09:14.875043+0000","last_peered":"2024-09-11T01:09:14.875043+0000","last_clean":"2024-09-11T01:09:14.875043+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:09:14.875043+0000","last_undegraded":"2024-09-11T01:09:14.875043+0000","last_fullsized":"2024-09-11T01:09:14.875043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:12.301491+0000","last_change":"2024-09-11T00:44:07.614485+0000","last_active":"2024-09-11T01:10:12.301491+0000","last_peered":"2024-09-11T01:10:12.301491+0000","last_clean":"2024-09-11T01:10:12.301491+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:10:12.301491+0000","last_undegraded":"2024-09-11T01:10:12.301491+0000","last_fullsized":"2024-09-11T01:10:12.301491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:06.593067+0000","last_clean_scrub_stamp":"2024-09-11T00:44:06.593067+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:42.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3469,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.218838+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T01:12:30.218838+0000","last_peered":"2024-09-11T01:12:30.218838+0000","last_clean":"2024-09-11T01:12:30.218838+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:12:30.218838+0000","last_undegraded":"2024-09-11T01:12:30.218838+0000","last_fullsized":"2024-09-11T01:12:30.218838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166643+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T01:12:32.166643+0000","last_peered":"2024-09-11T01:12:32.166643+0000","last_clean":"2024-09-11T01:12:32.166643+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:32.166643+0000","last_undegraded":"2024-09-11T01:12:32.166643+0000","last_fullsized":"2024-09-11T01:12:32.166643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:18.897991+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T01:11:18.897991+0000","last_peered":"2024-09-11T01:11:18.897991+0000","last_clean":"2024-09-11T01:11:18.897991+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:11:18.897991+0000","last_undegraded":"2024-09-11T01:11:18.897991+0000","last_fullsized":"2024-09-11T01:11:18.897991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3631,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307081+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T01:12:30.307081+0000","last_peered":"2024-09-11T01:12:30.307081+0000","last_clean":"2024-09-11T01:12:30.307081+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:30.307081+0000","last_undegraded":"2024-09-11T01:12:30.307081+0000","last_fullsized":"2024-09-11T01:12:30.307081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173027+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T01:12:32.173027+0000","last_peered":"2024-09-11T01:12:32.173027+0000","last_clean":"2024-09-11T01:12:32.173027+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:32.173027+0000","last_undegraded":"2024-09-11T01:12:32.173027+0000","last_fullsized":"2024-09-11T01:12:32.173027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:17.487776+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T01:11:17.487776+0000","last_peered":"2024-09-11T01:11:17.487776+0000","last_clean":"2024-09-11T01:11:17.487776+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:11:17.487776+0000","last_undegraded":"2024-09-11T01:11:17.487776+0000","last_fullsized":"2024-09-11T01:11:17.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3590,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.322566+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T01:12:30.322566+0000","last_peered":"2024-09-11T01:12:30.322566+0000","last_clean":"2024-09-11T01:12:30.322566+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:12:30.322566+0000","last_undegraded":"2024-09-11T01:12:30.322566+0000","last_fullsized":"2024-09-11T01:12:30.322566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178797+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T01:12:32.178797+0000","last_peered":"2024-09-11T01:12:32.178797+0000","last_clean":"2024-09-11T01:12:32.178797+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:32.178797+0000","last_undegraded":"2024-09-11T01:12:32.178797+0000","last_fullsized":"2024-09-11T01:12:32.178797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.233378+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T01:12:30.233378+0000","last_peered":"2024-09-11T01:12:30.233378+0000","last_clean":"2024-09-11T01:12:30.233378+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:30.233378+0000","last_undegraded":"2024-09-11T01:12:30.233378+0000","last_fullsized":"2024-09-11T01:12:30.233378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.210070+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T01:12:30.210070+0000","last_peered":"2024-09-11T01:12:30.210070+0000","last_clean":"2024-09-11T01:12:30.210070+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:12:30.210070+0000","last_undegraded":"2024-09-11T01:12:30.210070+0000","last_fullsized":"2024-09-11T01:12:30.210070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.184097+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T01:12:32.184097+0000","last_peered":"2024-09-11T01:12:32.184097+0000","last_clean":"2024-09-11T01:12:32.184097+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:32.184097+0000","last_undegraded":"2024-09-11T01:12:32.184097+0000","last_fullsized":"2024-09-11T01:12:32.184097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298932+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T01:12:30.298932+0000","last_peered":"2024-09-11T01:12:30.298932+0000","last_clean":"2024-09-11T01:12:30.298932+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:30.298932+0000","last_undegraded":"2024-09-11T01:12:30.298932+0000","last_fullsized":"2024-09-11T01:12:30.298932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3473,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.353343+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T01:12:30.353343+0000","last_peered":"2024-09-11T01:12:30.353343+0000","last_clean":"2024-09-11T01:12:30.353343+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:30.353343+0000","last_undegraded":"2024-09-11T01:12:30.353343+0000","last_fullsized":"2024-09-11T01:12:30.353343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170446+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T01:12:32.170446+0000","last_peered":"2024-09-11T01:12:32.170446+0000","last_clean":"2024-09-11T01:12:32.170446+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:32.170446+0000","last_undegraded":"2024-09-11T01:12:32.170446+0000","last_fullsized":"2024-09-11T01:12:32.170446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.257538+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T01:12:30.257538+0000","last_peered":"2024-09-11T01:12:30.257538+0000","last_clean":"2024-09-11T01:12:30.257538+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:30.257538+0000","last_undegraded":"2024-09-11T01:12:30.257538+0000","last_fullsized":"2024-09-11T01:12:30.257538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267004+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T01:12:30.267004+0000","last_peered":"2024-09-11T01:12:30.267004+0000","last_clean":"2024-09-11T01:12:30.267004+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:12:30.267004+0000","last_undegraded":"2024-09-11T01:12:30.267004+0000","last_fullsized":"2024-09-11T01:12:30.267004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.165269+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T01:12:32.165269+0000","last_peered":"2024-09-11T01:12:32.165269+0000","last_clean":"2024-09-11T01:12:32.165269+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:32.165269+0000","last_undegraded":"2024-09-11T01:12:32.165269+0000","last_fullsized":"2024-09-11T01:12:32.165269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.244504+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T01:12:30.244504+0000","last_peered":"2024-09-11T01:12:30.244504+0000","last_clean":"2024-09-11T01:12:30.244504+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:30.244504+0000","last_undegraded":"2024-09-11T01:12:30.244504+0000","last_fullsized":"2024-09-11T01:12:30.244504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.318719+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T01:12:30.318719+0000","last_peered":"2024-09-11T01:12:30.318719+0000","last_clean":"2024-09-11T01:12:30.318719+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:12:30.318719+0000","last_undegraded":"2024-09-11T01:12:30.318719+0000","last_fullsized":"2024-09-11T01:12:30.318719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174988+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T01:12:32.174988+0000","last_peered":"2024-09-11T01:12:32.174988+0000","last_clean":"2024-09-11T01:12:32.174988+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:32.174988+0000","last_undegraded":"2024-09-11T01:12:32.174988+0000","last_fullsized":"2024-09-11T01:12:32.174988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.180576+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T01:12:30.180576+0000","last_peered":"2024-09-11T01:12:30.180576+0000","last_clean":"2024-09-11T01:12:30.180576+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:30.180576+0000","last_undegraded":"2024-09-11T01:12:30.180576+0000","last_fullsized":"2024-09-11T01:12:30.180576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.348920+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T01:12:30.348920+0000","last_peered":"2024-09-11T01:12:30.348920+0000","last_clean":"2024-09-11T01:12:30.348920+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:30.348920+0000","last_undegraded":"2024-09-11T01:12:30.348920+0000","last_fullsized":"2024-09-11T01:12:30.348920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164904+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T01:12:32.164904+0000","last_peered":"2024-09-11T01:12:32.164904+0000","last_clean":"2024-09-11T01:12:32.164904+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:32.164904+0000","last_undegraded":"2024-09-11T01:12:32.164904+0000","last_fullsized":"2024-09-11T01:12:32.164904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256368+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T01:12:30.256368+0000","last_peered":"2024-09-11T01:12:30.256368+0000","last_clean":"2024-09-11T01:12:30.256368+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:30.256368+0000","last_undegraded":"2024-09-11T01:12:30.256368+0000","last_fullsized":"2024-09-11T01:12:30.256368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3514,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.053069+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T01:12:30.053069+0000","last_peered":"2024-09-11T01:12:30.053069+0000","last_clean":"2024-09-11T01:12:30.053069+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:12:30.053069+0000","last_undegraded":"2024-09-11T01:12:30.053069+0000","last_fullsized":"2024-09-11T01:12:30.053069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172462+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T01:12:32.172462+0000","last_peered":"2024-09-11T01:12:32.172462+0000","last_clean":"2024-09-11T01:12:32.172462+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:32.172462+0000","last_undegraded":"2024-09-11T01:12:32.172462+0000","last_fullsized":"2024-09-11T01:12:32.172462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'367","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.252206+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T01:12:30.252206+0000","last_peered":"2024-09-11T01:12:30.252206+0000","last_clean":"2024-09-11T01:12:30.252206+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:30.252206+0000","last_undegraded":"2024-09-11T01:12:30.252206+0000","last_fullsized":"2024-09-11T01:12:30.252206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3580,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.134688+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T01:12:30.134688+0000","last_peered":"2024-09-11T01:12:30.134688+0000","last_clean":"2024-09-11T01:12:30.134688+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:30.134688+0000","last_undegraded":"2024-09-11T01:12:30.134688+0000","last_fullsized":"2024-09-11T01:12:30.134688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178305+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T01:12:32.178305+0000","last_peered":"2024-09-11T01:12:32.178305+0000","last_clean":"2024-09-11T01:12:32.178305+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:32.178305+0000","last_undegraded":"2024-09-11T01:12:32.178305+0000","last_fullsized":"2024-09-11T01:12:32.178305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.863603+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T01:12:31.863603+0000","last_peered":"2024-09-11T01:12:31.863603+0000","last_clean":"2024-09-11T01:12:31.863603+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:31.863603+0000","last_undegraded":"2024-09-11T01:12:31.863603+0000","last_fullsized":"2024-09-11T01:12:31.863603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3760,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345509+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T01:12:30.345509+0000","last_peered":"2024-09-11T01:12:30.345509+0000","last_clean":"2024-09-11T01:12:30.345509+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:30.345509+0000","last_undegraded":"2024-09-11T01:12:30.345509+0000","last_fullsized":"2024-09-11T01:12:30.345509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177439+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T01:12:32.177439+0000","last_peered":"2024-09-11T01:12:32.177439+0000","last_clean":"2024-09-11T01:12:32.177439+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:32.177439+0000","last_undegraded":"2024-09-11T01:12:32.177439+0000","last_fullsized":"2024-09-11T01:12:32.177439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.145668+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T01:12:30.145668+0000","last_peered":"2024-09-11T01:12:30.145668+0000","last_clean":"2024-09-11T01:12:30.145668+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:30.145668+0000","last_undegraded":"2024-09-11T01:12:30.145668+0000","last_fullsized":"2024-09-11T01:12:30.145668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201774+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T01:12:30.201774+0000","last_peered":"2024-09-11T01:12:30.201774+0000","last_clean":"2024-09-11T01:12:30.201774+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:30.201774+0000","last_undegraded":"2024-09-11T01:12:30.201774+0000","last_fullsized":"2024-09-11T01:12:30.201774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183382+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T01:12:32.183382+0000","last_peered":"2024-09-11T01:12:32.183382+0000","last_clean":"2024-09-11T01:12:32.183382+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:32.183382+0000","last_undegraded":"2024-09-11T01:12:32.183382+0000","last_fullsized":"2024-09-11T01:12:32.183382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.251283+0000","last_change":"2024-09-11T00:44:16.350375+0000","last_active":"2024-09-11T01:10:53.251283+0000","last_peered":"2024-09-11T01:10:53.251283+0000","last_clean":"2024-09-11T01:10:53.251283+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:10:53.251283+0000","last_undegraded":"2024-09-11T01:10:53.251283+0000","last_fullsized":"2024-09-11T01:10:53.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4011,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.293685+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T01:12:30.293685+0000","last_peered":"2024-09-11T01:12:30.293685+0000","last_clean":"2024-09-11T01:12:30.293685+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:30.293685+0000","last_undegraded":"2024-09-11T01:12:30.293685+0000","last_fullsized":"2024-09-11T01:12:30.293685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.341995+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T01:12:30.341995+0000","last_peered":"2024-09-11T01:12:30.341995+0000","last_clean":"2024-09-11T01:12:30.341995+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:12:30.341995+0000","last_undegraded":"2024-09-11T01:12:30.341995+0000","last_fullsized":"2024-09-11T01:12:30.341995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174011+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T01:12:32.174011+0000","last_peered":"2024-09-11T01:12:32.174011+0000","last_clean":"2024-09-11T01:12:32.174011+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:32.174011+0000","last_undegraded":"2024-09-11T01:12:32.174011+0000","last_fullsized":"2024-09-11T01:12:32.174011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:29.280855+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T01:12:29.280855+0000","last_peered":"2024-09-11T01:12:29.280855+0000","last_clean":"2024-09-11T01:12:29.280855+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:29.280855+0000","last_undegraded":"2024-09-11T01:12:29.280855+0000","last_fullsized":"2024-09-11T01:12:29.280855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.279045+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T01:12:30.279045+0000","last_peered":"2024-09-11T01:12:30.279045+0000","last_clean":"2024-09-11T01:12:30.279045+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:12:30.279045+0000","last_undegraded":"2024-09-11T01:12:30.279045+0000","last_fullsized":"2024-09-11T01:12:30.279045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176842+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T01:12:32.176842+0000","last_peered":"2024-09-11T01:12:32.176842+0000","last_clean":"2024-09-11T01:12:32.176842+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:32.176842+0000","last_undegraded":"2024-09-11T01:12:32.176842+0000","last_fullsized":"2024-09-11T01:12:32.176842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.182691+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T01:10:53.182691+0000","last_peered":"2024-09-11T01:10:53.182691+0000","last_clean":"2024-09-11T01:10:53.182691+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:10:53.182691+0000","last_undegraded":"2024-09-11T01:10:53.182691+0000","last_fullsized":"2024-09-11T01:10:53.182691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267800+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T01:12:30.267800+0000","last_peered":"2024-09-11T01:12:30.267800+0000","last_clean":"2024-09-11T01:12:30.267800+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:30.267800+0000","last_undegraded":"2024-09-11T01:12:30.267800+0000","last_fullsized":"2024-09-11T01:12:30.267800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177191+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T01:12:32.177191+0000","last_peered":"2024-09-11T01:12:32.177191+0000","last_clean":"2024-09-11T01:12:32.177191+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:32.177191+0000","last_undegraded":"2024-09-11T01:12:32.177191+0000","last_fullsized":"2024-09-11T01:12:32.177191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3060,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.022723+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T01:12:30.022723+0000","last_peered":"2024-09-11T01:12:30.022723+0000","last_clean":"2024-09-11T01:12:30.022723+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:30.022723+0000","last_undegraded":"2024-09-11T01:12:30.022723+0000","last_fullsized":"2024-09-11T01:12:30.022723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'608","reported_seq":646,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:47.550566+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T01:11:47.550566+0000","last_peered":"2024-09-11T01:11:47.550566+0000","last_clean":"2024-09-11T01:11:47.550566+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:11:47.550566+0000","last_undegraded":"2024-09-11T01:11:47.550566+0000","last_fullsized":"2024-09-11T01:11:47.550566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180166+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T01:12:32.180166+0000","last_peered":"2024-09-11T01:12:32.180166+0000","last_clean":"2024-09-11T01:12:32.180166+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:32.180166+0000","last_undegraded":"2024-09-11T01:12:32.180166+0000","last_fullsized":"2024-09-11T01:12:32.180166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298969+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T01:12:30.298969+0000","last_peered":"2024-09-11T01:12:30.298969+0000","last_clean":"2024-09-11T01:12:30.298969+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:30.298969+0000","last_undegraded":"2024-09-11T01:12:30.298969+0000","last_fullsized":"2024-09-11T01:12:30.298969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167609+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T01:12:32.167609+0000","last_peered":"2024-09-11T01:12:32.167609+0000","last_clean":"2024-09-11T01:12:32.167609+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:32.167609+0000","last_undegraded":"2024-09-11T01:12:32.167609+0000","last_fullsized":"2024-09-11T01:12:32.167609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.159359+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T01:12:32.159359+0000","last_peered":"2024-09-11T01:12:32.159359+0000","last_clean":"2024-09-11T01:12:32.159359+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:32.159359+0000","last_undegraded":"2024-09-11T01:12:32.159359+0000","last_fullsized":"2024-09-11T01:12:32.159359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178354+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T01:12:32.178354+0000","last_peered":"2024-09-11T01:12:32.178354+0000","last_clean":"2024-09-11T01:12:32.178354+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:32.178354+0000","last_undegraded":"2024-09-11T01:12:32.178354+0000","last_fullsized":"2024-09-11T01:12:32.178354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175700+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T01:12:32.175700+0000","last_peered":"2024-09-11T01:12:32.175700+0000","last_clean":"2024-09-11T01:12:32.175700+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:32.175700+0000","last_undegraded":"2024-09-11T01:12:32.175700+0000","last_fullsized":"2024-09-11T01:12:32.175700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177831+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T01:12:32.177831+0000","last_peered":"2024-09-11T01:12:32.177831+0000","last_clean":"2024-09-11T01:12:32.177831+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:32.177831+0000","last_undegraded":"2024-09-11T01:12:32.177831+0000","last_fullsized":"2024-09-11T01:12:32.177831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.152165+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T01:12:32.152165+0000","last_peered":"2024-09-11T01:12:32.152165+0000","last_clean":"2024-09-11T01:12:32.152165+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:32.152165+0000","last_undegraded":"2024-09-11T01:12:32.152165+0000","last_fullsized":"2024-09-11T01:12:32.152165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183309+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T01:12:32.183309+0000","last_peered":"2024-09-11T01:12:32.183309+0000","last_clean":"2024-09-11T01:12:32.183309+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:32.183309+0000","last_undegraded":"2024-09-11T01:12:32.183309+0000","last_fullsized":"2024-09-11T01:12:32.183309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175313+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T01:12:32.175313+0000","last_peered":"2024-09-11T01:12:32.175313+0000","last_clean":"2024-09-11T01:12:32.175313+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:32.175313+0000","last_undegraded":"2024-09-11T01:12:32.175313+0000","last_fullsized":"2024-09-11T01:12:32.175313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178446+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T01:12:32.178446+0000","last_peered":"2024-09-11T01:12:32.178446+0000","last_clean":"2024-09-11T01:12:32.178446+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:12:32.178446+0000","last_undegraded":"2024-09-11T01:12:32.178446+0000","last_fullsized":"2024-09-11T01:12:32.178446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.179104+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T01:12:32.179104+0000","last_peered":"2024-09-11T01:12:32.179104+0000","last_clean":"2024-09-11T01:12:32.179104+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:32.179104+0000","last_undegraded":"2024-09-11T01:12:32.179104+0000","last_fullsized":"2024-09-11T01:12:32.179104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170124+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T01:12:32.170124+0000","last_peered":"2024-09-11T01:12:32.170124+0000","last_clean":"2024-09-11T01:12:32.170124+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:32.170124+0000","last_undegraded":"2024-09-11T01:12:32.170124+0000","last_fullsized":"2024-09-11T01:12:32.170124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180410+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T01:12:32.180410+0000","last_peered":"2024-09-11T01:12:32.180410+0000","last_clean":"2024-09-11T01:12:32.180410+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:32.180410+0000","last_undegraded":"2024-09-11T01:12:32.180410+0000","last_fullsized":"2024-09-11T01:12:32.180410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177471+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T01:12:32.177471+0000","last_peered":"2024-09-11T01:12:32.177471+0000","last_clean":"2024-09-11T01:12:32.177471+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:32.177471+0000","last_undegraded":"2024-09-11T01:12:32.177471+0000","last_fullsized":"2024-09-11T01:12:32.177471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169364+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T01:12:32.169364+0000","last_peered":"2024-09-11T01:12:32.169364+0000","last_clean":"2024-09-11T01:12:32.169364+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:12:32.169364+0000","last_undegraded":"2024-09-11T01:12:32.169364+0000","last_fullsized":"2024-09-11T01:12:32.169364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.168873+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T01:12:32.168873+0000","last_peered":"2024-09-11T01:12:32.168873+0000","last_clean":"2024-09-11T01:12:32.168873+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:32.168873+0000","last_undegraded":"2024-09-11T01:12:32.168873+0000","last_fullsized":"2024-09-11T01:12:32.168873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174517+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T01:12:32.174517+0000","last_peered":"2024-09-11T01:12:32.174517+0000","last_clean":"2024-09-11T01:12:32.174517+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:12:32.174517+0000","last_undegraded":"2024-09-11T01:12:32.174517+0000","last_fullsized":"2024-09-11T01:12:32.174517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.171124+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T01:12:32.171124+0000","last_peered":"2024-09-11T01:12:32.171124+0000","last_clean":"2024-09-11T01:12:32.171124+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:12:32.171124+0000","last_undegraded":"2024-09-11T01:12:32.171124+0000","last_fullsized":"2024-09-11T01:12:32.171124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175872+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T01:12:32.175872+0000","last_peered":"2024-09-11T01:12:32.175872+0000","last_clean":"2024-09-11T01:12:32.175872+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:32.175872+0000","last_undegraded":"2024-09-11T01:12:32.175872+0000","last_fullsized":"2024-09-11T01:12:32.175872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.155284+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T01:12:32.155284+0000","last_peered":"2024-09-11T01:12:32.155284+0000","last_clean":"2024-09-11T01:12:32.155284+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:32.155284+0000","last_undegraded":"2024-09-11T01:12:32.155284+0000","last_fullsized":"2024-09-11T01:12:32.155284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169520+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T01:12:32.169520+0000","last_peered":"2024-09-11T01:12:32.169520+0000","last_clean":"2024-09-11T01:12:32.169520+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:32.169520+0000","last_undegraded":"2024-09-11T01:12:32.169520+0000","last_fullsized":"2024-09-11T01:12:32.169520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180898+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T01:12:32.180898+0000","last_peered":"2024-09-11T01:12:32.180898+0000","last_clean":"2024-09-11T01:12:32.180898+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:32.180898+0000","last_undegraded":"2024-09-11T01:12:32.180898+0000","last_fullsized":"2024-09-11T01:12:32.180898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172147+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T01:12:32.172147+0000","last_peered":"2024-09-11T01:12:32.172147+0000","last_clean":"2024-09-11T01:12:32.172147+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:32.172147+0000","last_undegraded":"2024-09-11T01:12:32.172147+0000","last_fullsized":"2024-09-11T01:12:32.172147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181309+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T01:12:32.181309+0000","last_peered":"2024-09-11T01:12:32.181309+0000","last_clean":"2024-09-11T01:12:32.181309+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:32.181309+0000","last_undegraded":"2024-09-11T01:12:32.181309+0000","last_fullsized":"2024-09-11T01:12:32.181309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166759+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T01:12:32.166759+0000","last_peered":"2024-09-11T01:12:32.166759+0000","last_clean":"2024-09-11T01:12:32.166759+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:32.166759+0000","last_undegraded":"2024-09-11T01:12:32.166759+0000","last_fullsized":"2024-09-11T01:12:32.166759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180470+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T01:12:32.180470+0000","last_peered":"2024-09-11T01:12:32.180470+0000","last_clean":"2024-09-11T01:12:32.180470+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:32.180470+0000","last_undegraded":"2024-09-11T01:12:32.180470+0000","last_fullsized":"2024-09-11T01:12:32.180470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164129+0000","last_change":"2024-09-11T00:44:57.516134+0000","last_active":"2024-09-11T01:12:32.164129+0000","last_peered":"2024-09-11T01:12:32.164129+0000","last_clean":"2024-09-11T01:12:32.164129+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:32.164129+0000","last_undegraded":"2024-09-11T01:12:32.164129+0000","last_fullsized":"2024-09-11T01:12:32.164129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175616+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T01:12:32.175616+0000","last_peered":"2024-09-11T01:12:32.175616+0000","last_clean":"2024-09-11T01:12:32.175616+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:32.175616+0000","last_undegraded":"2024-09-11T01:12:32.175616+0000","last_fullsized":"2024-09-11T01:12:32.175616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177037+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T01:12:32.177037+0000","last_peered":"2024-09-11T01:12:32.177037+0000","last_clean":"2024-09-11T01:12:32.177037+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:32.177037+0000","last_undegraded":"2024-09-11T01:12:32.177037+0000","last_fullsized":"2024-09-11T01:12:32.177037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177662+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T01:12:32.177662+0000","last_peered":"2024-09-11T01:12:32.177662+0000","last_clean":"2024-09-11T01:12:32.177662+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:32.177662+0000","last_undegraded":"2024-09-11T01:12:32.177662+0000","last_fullsized":"2024-09-11T01:12:32.177662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175993+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T01:12:32.175993+0000","last_peered":"2024-09-11T01:12:32.175993+0000","last_clean":"2024-09-11T01:12:32.175993+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:32.175993+0000","last_undegraded":"2024-09-11T01:12:32.175993+0000","last_fullsized":"2024-09-11T01:12:32.175993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166210+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T01:12:32.166210+0000","last_peered":"2024-09-11T01:12:32.166210+0000","last_clean":"2024-09-11T01:12:32.166210+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:32.166210+0000","last_undegraded":"2024-09-11T01:12:32.166210+0000","last_fullsized":"2024-09-11T01:12:32.166210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173362+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T01:12:32.173362+0000","last_peered":"2024-09-11T01:12:32.173362+0000","last_clean":"2024-09-11T01:12:32.173362+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:32.173362+0000","last_undegraded":"2024-09-11T01:12:32.173362+0000","last_fullsized":"2024-09-11T01:12:32.173362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15867448,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3777,"num_write_kb":16855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31734896,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3296,"ondisk_log_size":3296,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509783,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7507902,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574232,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93797608,"statfs":{"total":96636764160,"available":96048750592,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509783,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509784,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7508664,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7383683,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7384445,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:12:39.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 -- 172.21.15.81:0/968219941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 msgr2=0x7fda1c165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 --2- 172.21.15.81:0/968219941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 0x7fda1c165da0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda14009860 tx=0x7fda1402a5c0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 -- 172.21.15.81:0/968219941 shutdown_connections 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 --2- 172.21.15.81:0/968219941 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 0x7fda1c165da0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 -- 172.21.15.81:0/968219941 >> 172.21.15.81:0/968219941 conn(0x7fda1c0688e0 msgr2=0x7fda1c068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 -- 172.21.15.81:0/968219941 shutdown_connections 2024-09-11T01:12:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.128+0000 7fda20a00640 1 -- 172.21.15.81:0/968219941 wait complete. 2024-09-11T01:12:40.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.130+0000 7fda20a00640 1 Processor -- start 2024-09-11T01:12:40.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.130+0000 7fda20a00640 1 -- start start 2024-09-11T01:12:40.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:40.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1c154760 0x7fda1c1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:40.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 0x7fda1c1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:40.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0cc930 con 0x7fda1c0cafb0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0cc650 con 0x7fda1c154760 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda20a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda1c0ccc10 con 0x7fda1c15e410 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50902/0 (socket says 172.21.15.81:50902) 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 -- 172.21.15.81:0/1544804701 learned_addr learned my addr 172.21.15.81:0/1544804701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 -- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 msgr2=0x7fda1c1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 0x7fda1c1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 -- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1c154760 msgr2=0x7fda1c1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1c154760 0x7fda1c1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.131+0000 7fda1a800640 1 -- 172.21.15.81:0/1544804701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c15b760 con 0x7fda1c0cafb0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda1a800640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fda0c001f10 tx=0x7fda0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c016020 con 0x7fda1c0cafb0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda0c012420 con 0x7fda1c0cafb0 2024-09-11T01:12:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c012870 con 0x7fda1c0cafb0 2024-09-11T01:12:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c1f0830 con 0x7fda1c0cafb0 2024-09-11T01:12:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.132+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c1f0df0 con 0x7fda1c0cafb0 2024-09-11T01:12:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.133+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1c151820 con 0x7fda1c0cafb0 2024-09-11T01:12:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.134+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda0c01b400 con 0x7fda1c0cafb0 2024-09-11T01:12:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.135+0000 7fda12a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 0x7fd9fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.135+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fda0c09adc0 con 0x7fda1c0cafb0 2024-09-11T01:12:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.136+0000 7fda19e00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 0x7fd9fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.136+0000 7fda19e00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 0x7fd9fc07a430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda08007fd0 tx=0x7fda080078e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:40.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.139+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fda0c020020 con 0x7fda1c0cafb0 2024-09-11T01:12:40.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.325+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda1c0b37f0 con 0x7fda1c0cafb0 2024-09-11T01:12:40.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.326+0000 7fda12a00640 1 -- 172.21.15.81:0/1544804701 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7fda0c063420 con 0x7fda1c0cafb0 2024-09-11T01:12:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:40.328 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:57.502396+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.328+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 msgr2=0x7fd9fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.328+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 0x7fd9fc07a430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda08007fd0 tx=0x7fda080078e0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.328+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 msgr2=0x7fda1c0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.328+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fda0c001f10 tx=0x7fda0c00a430 comp rx=0 tx=0).stop 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 shutdown_connections 2024-09-11T01:12:40.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd9fc077f70 0x7fd9fc07a430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1c15e410 0x7fda1c1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1c154760 0x7fda1c1528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 --2- 172.21.15.81:0/1544804701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c0cafb0 0x7fda1c0c85b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 >> 172.21.15.81:0/1544804701 conn(0x7fda1c0688e0 msgr2=0x7fda1c14f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 shutdown_connections 2024-09-11T01:12:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:40.329+0000 7fda20a00640 1 -- 172.21.15.81:0/1544804701 wait complete. 2024-09-11T01:12:41.347 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T01:12:41.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 -- 172.21.15.81:0/3887680197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 msgr2=0x7f1fe415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 --2- 172.21.15.81:0/3887680197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe415c110 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0005fd0 tx=0x7f1fd002a660 comp rx=0 tx=0).stop 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 -- 172.21.15.81:0/3887680197 shutdown_connections 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 --2- 172.21.15.81:0/3887680197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe415c110 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 --2- 172.21.15.81:0/3887680197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fe4152880 0x7f1fe40725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 -- 172.21.15.81:0/3887680197 >> 172.21.15.81:0/3887680197 conn(0x7f1fe406ffb0 msgr2=0x7f1fe40703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 -- 172.21.15.81:0/3887680197 shutdown_connections 2024-09-11T01:12:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.507+0000 7f1feb800640 1 -- 172.21.15.81:0/3887680197 wait complete. 2024-09-11T01:12:41.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.509+0000 7f1feb800640 1 Processor -- start 2024-09-11T01:12:41.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.509+0000 7f1feb800640 1 -- start start 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fe4152880 0x7f1fe40c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fe415c650 0x7f1fe40c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe406ee60 con 0x7f1fe4070b80 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4152c60 con 0x7f1fe4152880 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1feb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe406efe0 con 0x7f1fe415c650 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50924/0 (socket says 172.21.15.81:50924) 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 -- 172.21.15.81:0/669592524 learned_addr learned my addr 172.21.15.81:0/669592524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe3e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fe4152880 0x7f1fe40c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 -- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fe415c650 msgr2=0x7f1fe40c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fe415c650 0x7f1fe40c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 -- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fe4152880 msgr2=0x7f1fe40c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fe4152880 0x7f1fe40c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.510+0000 7f1fe8e00640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe40c21b0 con 0x7f1fe4070b80 2024-09-11T01:12:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1fe8e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4db0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400ba50 tx=0x7f1fd400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4019070 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fd400cc90 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40146a0 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe40c2450 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.511+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe4159e00 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.512+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fe4158270 con 0x7f1fe4070b80 2024-09-11T01:12:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.513+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1fd401d3b0 con 0x7f1fe4070b80 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe0c00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1fc4077f70 0x7f1fc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f1fd409a210 con 0x7f1fe4070b80 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe0c00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f1fc4081730 0x7f1fc4083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fd401ce50 con 0x7f1fc4081730 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1fd40a1050 con 0x7f1fe4070b80 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.514+0000 7f1fe3e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1fc4077f70 0x7f1fc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.515+0000 7f1fe9800640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f1fc4081730 0x7f1fc4083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.515+0000 7f1fe9800640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f1fc4081730 0x7f1fc4083bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.515+0000 7f1fe3e00640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1fc4077f70 0x7f1fc407a430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0033000 tx=0x7f1fd0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.516+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== osd.0 v2:172.21.15.81:6800/1565697795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fd401ce50 con 0x7f1fc4081730 2024-09-11T01:12:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.530+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 --> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1fe41521e0 con 0x7f1fc4081730 2024-09-11T01:12:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.530+0000 7f1fe0c00640 1 -- 172.21.15.81:0/669592524 <== osd.0 v2:172.21.15.81:6800/1565697795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1fe41521e0 con 0x7f1fc4081730 2024-09-11T01:12:41.532 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:41.533 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:41.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.530+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f1fc4081730 msgr2=0x7f1fc4083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.530+0000 7f1feb800640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:6800/1565697795,v1:172.21.15.81:6802/1565697795] conn(0x7f1fc4081730 0x7f1fc4083bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1fc4077f70 msgr2=0x7f1fc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f1fc4077f70 0x7f1fc407a430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0033000 tx=0x7f1fd0004730 comp rx=0 tx=0).stop 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 msgr2=0x7f1fe40c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 --2- 172.21.15.81:0/669592524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fe4070b80 0x7f1fe40c4db0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400ba50 tx=0x7f1fd400bf10 comp rx=0 tx=0).stop 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1fe9800640 1 -- 172.21.15.81:0/669592524 reap_dead start 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 shutdown_connections 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 >> 172.21.15.81:0/669592524 conn(0x7f1fe406ffb0 msgr2=0x7f1fe406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 shutdown_connections 2024-09-11T01:12:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.531+0000 7f1feb800640 1 -- 172.21.15.81:0/669592524 wait complete. 2024-09-11T01:12:41.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 -- 172.21.15.81:0/3986595408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 msgr2=0x7fd80400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 --2- 172.21.15.81:0/3986595408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd80400b9c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c610 tx=0x7fd804005830 comp rx=0 tx=0).stop 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 -- 172.21.15.81:0/3986595408 shutdown_connections 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 --2- 172.21.15.81:0/3986595408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd80400b9c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 -- 172.21.15.81:0/3986595408 >> 172.21.15.81:0/3986595408 conn(0x7fd82006ffd0 msgr2=0x7fd8200703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 -- 172.21.15.81:0/3986595408 shutdown_connections 2024-09-11T01:12:41.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.707+0000 7fd81f200640 1 -- 172.21.15.81:0/3986595408 wait complete. 2024-09-11T01:12:41.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.709+0000 7fd81f200640 1 Processor -- start 2024-09-11T01:12:41.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.709+0000 7fd81f200640 1 -- start start 2024-09-11T01:12:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 0x7fd820148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 0x7fd8201ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8200c7040 con 0x7fd804005230 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8201581a0 con 0x7fd820149ac0 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd82014efa0 con 0x7fd820151ea0 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50946/0 (socket says 172.21.15.81:50946) 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 -- 172.21.15.81:0/883520738 learned_addr learned my addr 172.21.15.81:0/883520738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd815400640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 0x7fd820148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 -- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 msgr2=0x7fd820148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 0x7fd820148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 -- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 msgr2=0x7fd8201ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81e800640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 0x7fd8201ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.710+0000 7fd81de00640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 0x7fd8201ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd81de00640 1 -- 172.21.15.81:0/883520738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8200c3500 con 0x7fd804005230 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd815400640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 0x7fd820148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd81e800640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 0x7fd8201ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd81de00640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd810004f00 tx=0x7fd810001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810015020 con 0x7fd804005230 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd810011960 con 0x7fd804005230 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810011d90 con 0x7fd804005230 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8200c37e0 con 0x7fd804005230 2024-09-11T01:12:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.711+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82014f6b0 con 0x7fd804005230 2024-09-11T01:12:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.712+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8200745f0 con 0x7fd804005230 2024-09-11T01:12:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.713+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd81001a400 con 0x7fd804005230 2024-09-11T01:12:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.714+0000 7fd816a00640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 0x7fd7fc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.714+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd81009ae80 con 0x7fd804005230 2024-09-11T01:12:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.715+0000 7fd815400640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 0x7fd7fc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.715+0000 7fd815400640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 0x7fd7fc07a460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8200c6f20 tx=0x7fd808005f90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.719+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd81001f020 con 0x7fd804005230 2024-09-11T01:12:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.902+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd82015c570 con 0x7fd7fc077fa0 2024-09-11T01:12:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.903+0000 7fd816a00640 1 -- 172.21.15.81:0/883520738 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd82015c570 con 0x7fd7fc077fa0 2024-09-11T01:12:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T01:12:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 msgr2=0x7fd7fc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 0x7fd7fc07a460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8200c6f20 tx=0x7fd808005f90 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 msgr2=0x7fd820150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd810004f00 tx=0x7fd810001630 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 shutdown_connections 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd7fc077fa0 0x7fd7fc07a460 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd820149ac0 0x7fd8201ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd820151ea0 0x7fd820148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 --2- 172.21.15.81:0/883520738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd804005230 0x7fd820150d50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 >> 172.21.15.81:0/883520738 conn(0x7fd82006ffd0 msgr2=0x7fd8200cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 shutdown_connections 2024-09-11T01:12:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:41.906+0000 7fd81f200640 1 -- 172.21.15.81:0/883520738 wait complete. 2024-09-11T01:12:41.925 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T01:12:41.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.084+0000 7fc27fe00640 1 -- 172.21.15.81:0/207500757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780c90d0 msgr2=0x7fc2780c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.084+0000 7fc27fe00640 1 --2- 172.21.15.81:0/207500757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780c90d0 0x7fc2780c9560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc270005fd0 tx=0x7fc27002a670 comp rx=0 tx=0).stop 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 -- 172.21.15.81:0/207500757 shutdown_connections 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 --2- 172.21.15.81:0/207500757 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2780738a0 0x7fc278068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 --2- 172.21.15.81:0/207500757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780c90d0 0x7fc2780c9560 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 -- 172.21.15.81:0/207500757 >> 172.21.15.81:0/207500757 conn(0x7fc278069590 msgr2=0x7fc278070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 -- 172.21.15.81:0/207500757 shutdown_connections 2024-09-11T01:12:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.085+0000 7fc27fe00640 1 -- 172.21.15.81:0/207500757 wait complete. 2024-09-11T01:12:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.086+0000 7fc27fe00640 1 Processor -- start 2024-09-11T01:12:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.086+0000 7fc27fe00640 1 -- start start 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 0x7fc27814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2780c90d0 0x7fc2781f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2781546e0 0x7fc2781f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc278074ae0 con 0x7fc2780738a0 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc278074800 con 0x7fc2780c90d0 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc278158110 con 0x7fc2781546e0 2024-09-11T01:12:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 0x7fc27814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 0x7fc27814f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50976/0 (socket says 172.21.15.81:50976) 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.087+0000 7fc27d400640 1 -- 172.21.15.81:0/3849675990 learned_addr learned my addr 172.21.15.81:0/3849675990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27ca00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2780c90d0 0x7fc2781f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27de00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2781546e0 0x7fc2781f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 -- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2781546e0 msgr2=0x7fc2781f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2781546e0 0x7fc2781f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 -- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2780c90d0 msgr2=0x7fc2781f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2780c90d0 0x7fc2781f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27815a200 con 0x7fc2780738a0 2024-09-11T01:12:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27d400640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 0x7fc27814f4a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c730 tx=0x7fc26c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c003b70 con 0x7fc2780738a0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc26c003d30 con 0x7fc2780738a0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00aa50 con 0x7fc2780738a0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2781e3ae0 con 0x7fc2780738a0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.088+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27815a470 con 0x7fc2780738a0 2024-09-11T01:12:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.089+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2780c9bd0 con 0x7fc2780738a0 2024-09-11T01:12:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.090+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc26c00abf0 con 0x7fc2780738a0 2024-09-11T01:12:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.091+0000 7fc275600640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc258077f70 0x7fc25807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fc26c099fa0 con 0x7fc2780738a0 2024-09-11T01:12:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc275600640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7fc258081730 0x7fc258083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc258084280 con 0x7fc258081730 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc26c09c5c0 con 0x7fc2780738a0 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc27ca00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc258077f70 0x7fc25807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.092+0000 7fc27de00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7fc258081730 0x7fc258083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.093+0000 7fc27ca00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc258077f70 0x7fc25807a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc278159d30 tx=0x7fc26400b5b0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.093+0000 7fc27de00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7fc258081730 0x7fc258083bb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.093+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== osd.1 v2:172.21.15.81:6816/1592127640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc258084280 con 0x7fc258081730 2024-09-11T01:12:42.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.106+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 --> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2780cd450 con 0x7fc258081730 2024-09-11T01:12:42.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc275600640 1 -- 172.21.15.81:0/3849675990 <== osd.1 v2:172.21.15.81:6816/1592127640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc2780cd450 con 0x7fc258081730 2024-09-11T01:12:42.110 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:42.110 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7fc258081730 msgr2=0x7fc258083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:6816/1592127640,v1:172.21.15.81:6817/1592127640] conn(0x7fc258081730 0x7fc258083bb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc258077f70 msgr2=0x7fc25807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fc258077f70 0x7fc25807a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc278159d30 tx=0x7fc26400b5b0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 msgr2=0x7fc27814f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 --2- 172.21.15.81:0/3849675990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2780738a0 0x7fc27814f4a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c730 tx=0x7fc26c00cbf0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27de00640 1 -- 172.21.15.81:0/3849675990 reap_dead start 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 shutdown_connections 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 >> 172.21.15.81:0/3849675990 conn(0x7fc278069590 msgr2=0x7fc2780ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 shutdown_connections 2024-09-11T01:12:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.107+0000 7fc27fe00640 1 -- 172.21.15.81:0/3849675990 wait complete. 2024-09-11T01:12:42.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T01:12:42.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 -- 172.21.15.81:0/4251267369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 msgr2=0x7f981815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 --2- 172.21.15.81:0/4251267369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981815ba70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9810005fd0 tx=0x7f981002a5d0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 -- 172.21.15.81:0/4251267369 shutdown_connections 2024-09-11T01:12:42.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 --2- 172.21.15.81:0/4251267369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981815ba70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 --2- 172.21.15.81:0/4251267369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98180b1f10 0x7f98180745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 -- 172.21.15.81:0/4251267369 >> 172.21.15.81:0/4251267369 conn(0x7f981806ffd0 msgr2=0x7f98180703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 -- 172.21.15.81:0/4251267369 shutdown_connections 2024-09-11T01:12:42.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.282+0000 7f9817e00640 1 -- 172.21.15.81:0/4251267369 wait complete. 2024-09-11T01:12:42.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.284+0000 7f9817e00640 1 Processor -- start 2024-09-11T01:12:42.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.284+0000 7f9817e00640 1 -- start start 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98180b1f10 0x7f98181eea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981814ebc0 0x7f9818154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98180c7040 con 0x7f9818074b30 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98181581a0 con 0x7f98180b1f10 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f981814efa0 con 0x7f981814ebc0 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9816a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9816a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50992/0 (socket says 172.21.15.81:50992) 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9816a00640 1 -- 172.21.15.81:0/1672498217 learned_addr learned my addr 172.21.15.81:0/1672498217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9817400640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981814ebc0 0x7f9818154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.285+0000 7f9816000640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98180b1f10 0x7f98181eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 -- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981814ebc0 msgr2=0x7f9818154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981814ebc0 0x7f9818154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 -- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98180b1f10 msgr2=0x7f98181eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98180b1f10 0x7f98181eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 -- 172.21.15.81:0/1672498217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9818152cc0 con 0x7f9818074b30 2024-09-11T01:12:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9816a00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f980800c760 tx=0x7f980800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808003b70 con 0x7f9818074b30 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9808003d30 con 0x7f9818074b30 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980800aab0 con 0x7f9818074b30 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98180c5560 con 0x7f9818074b30 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.286+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9818154140 con 0x7f9818074b30 2024-09-11T01:12:42.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.287+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98180745f0 con 0x7f9818074b30 2024-09-11T01:12:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.288+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f980800ac50 con 0x7f9818074b30 2024-09-11T01:12:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.289+0000 7f980ea00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 0x7f97f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.289+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f9808099ee0 con 0x7f9818074b30 2024-09-11T01:12:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.289+0000 7f9816000640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 0x7f97f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.290+0000 7f9816000640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 0x7f97f807a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f9804005850 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.293+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9808062660 con 0x7f9818074b30 2024-09-11T01:12:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.485+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f98180c72b0 con 0x7f97f8077f70 2024-09-11T01:12:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.486+0000 7f980ea00640 1 -- 172.21.15.81:0/1672498217 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f98180c72b0 con 0x7f97f8077f70 2024-09-11T01:12:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 msgr2=0x7f97f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 0x7f97f807a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f9804005850 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 msgr2=0x7f981814dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f980800c760 tx=0x7f980800cc20 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 shutdown_connections 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f97f8077f70 0x7f97f807a430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f981814ebc0 0x7f9818154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98180b1f10 0x7f98181eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 --2- 172.21.15.81:0/1672498217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9818074b30 0x7f981814dde0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 >> 172.21.15.81:0/1672498217 conn(0x7f981806ffd0 msgr2=0x7f98180c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 shutdown_connections 2024-09-11T01:12:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.488+0000 7f9817e00640 1 -- 172.21.15.81:0/1672498217 wait complete. 2024-09-11T01:12:42.506 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T01:12:42.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 -- 172.21.15.81:0/148372495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b41546e0 msgr2=0x7f39b40c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 --2- 172.21.15.81:0/148372495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b41546e0 0x7f39b40c70f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009900 tx=0x7f39a002a6e0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 -- 172.21.15.81:0/148372495 shutdown_connections 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 --2- 172.21.15.81:0/148372495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b41546e0 0x7f39b40c70f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 -- 172.21.15.81:0/148372495 >> 172.21.15.81:0/148372495 conn(0x7f39b406ffb0 msgr2=0x7f39b40703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 -- 172.21.15.81:0/148372495 shutdown_connections 2024-09-11T01:12:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.665+0000 7f39ba000640 1 -- 172.21.15.81:0/148372495 wait complete. 2024-09-11T01:12:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.667+0000 7f39ba000640 1 Processor -- start 2024-09-11T01:12:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.667+0000 7f39ba000640 1 -- start start 2024-09-11T01:12:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 0x7f39b4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39b4154300 0x7f39b4149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39b41546e0 0x7f39b41f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4154b30 con 0x7f39b406e750 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39b406f7e0 con 0x7f39b4154300 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39ba000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f39b40c8710 con 0x7f39b41546e0 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 0x7f39b4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 0x7f39b4149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51014/0 (socket says 172.21.15.81:51014) 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39b3400640 1 -- 172.21.15.81:0/763911529 learned_addr learned my addr 172.21.15.81:0/763911529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39b2a00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39b4154300 0x7f39b4149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.668+0000 7f39b3e00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39b41546e0 0x7f39b41f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 -- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39b41546e0 msgr2=0x7f39b41f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39b41546e0 0x7f39b41f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 -- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39b4154300 msgr2=0x7f39b4149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39b4154300 0x7f39b4149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b41e4670 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39b3400640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 0x7f39b4149840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c400 tx=0x7f39a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4017070 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a40053c0 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4003850 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b414b180 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.669+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b4158470 con 0x7f39b406e750 2024-09-11T01:12:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.670+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39b406ac80 con 0x7f39b406e750 2024-09-11T01:12:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.672+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f39a40039f0 con 0x7f39b406e750 2024-09-11T01:12:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39ab400640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3994077f70 0x7f399407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f39a40996e0 con 0x7f39b406e750 2024-09-11T01:12:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39ab400640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f3994081730 0x7f3994083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3994084280 con 0x7f3994081730 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39a40a0050 con 0x7f39b406e750 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39b2a00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3994077f70 0x7f399407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.673+0000 7f39b3e00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f3994081730 0x7f3994083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.674+0000 7f39b3e00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f3994081730 0x7f3994083bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.674+0000 7f39b2a00640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3994077f70 0x7f399407a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39a0033000 tx=0x7f39a0004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.675+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== osd.2 v2:172.21.15.81:6824/2087915132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3994084280 con 0x7f3994081730 2024-09-11T01:12:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 --> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f39b41e6860 con 0x7f3994081730 2024-09-11T01:12:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ab400640 1 -- 172.21.15.81:0/763911529 <== osd.2 v2:172.21.15.81:6824/2087915132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f39b41e6860 con 0x7f3994081730 2024-09-11T01:12:42.690 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:42.691 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f3994081730 msgr2=0x7f3994083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:6824/2087915132,v1:172.21.15.81:6825/2087915132] conn(0x7f3994081730 0x7f3994083bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3994077f70 msgr2=0x7f399407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3994077f70 0x7f399407a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39a0033000 tx=0x7f39a0004730 comp rx=0 tx=0).stop 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 msgr2=0x7f39b4149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 --2- 172.21.15.81:0/763911529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b406e750 0x7f39b4149840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c400 tx=0x7f39a400c8c0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39b3e00640 1 -- 172.21.15.81:0/763911529 reap_dead start 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 shutdown_connections 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.688+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 >> 172.21.15.81:0/763911529 conn(0x7f39b406ffb0 msgr2=0x7f39b414ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.689+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 shutdown_connections 2024-09-11T01:12:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.689+0000 7f39ba000640 1 -- 172.21.15.81:0/763911529 wait complete. 2024-09-11T01:12:42.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 -- 172.21.15.81:0/3358956310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898152610 msgr2=0x7fe8980c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 --2- 172.21.15.81:0/3358956310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898152610 0x7fe8980c0f90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe898074fb0 tx=0x7fe88802ab10 comp rx=0 tx=0).stop 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 -- 172.21.15.81:0/3358956310 shutdown_connections 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 --2- 172.21.15.81:0/3358956310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8980c8680 0x7fe898162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 --2- 172.21.15.81:0/3358956310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898152610 0x7fe8980c0f90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 -- 172.21.15.81:0/3358956310 >> 172.21.15.81:0/3358956310 conn(0x7fe8980700f0 msgr2=0x7fe898070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 -- 172.21.15.81:0/3358956310 shutdown_connections 2024-09-11T01:12:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.861+0000 7fe89e000640 1 -- 172.21.15.81:0/3358956310 wait complete. 2024-09-11T01:12:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.863+0000 7fe89e000640 1 Processor -- start 2024-09-11T01:12:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.863+0000 7fe89e000640 1 -- start start 2024-09-11T01:12:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898074860 0x7fe898142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe898143ee0 0x7fe8981596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe898070cf0 con 0x7fe898152610 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe89815c140 con 0x7fe898074860 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe89e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe8980c8090 con 0x7fe898143ee0 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51026/0 (socket says 172.21.15.81:51026) 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 -- 172.21.15.81:0/3890697778 learned_addr learned my addr 172.21.15.81:0/3890697778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe897400640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898074860 0x7fe898142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe897e00640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe898143ee0 0x7fe8981596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 -- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe898143ee0 msgr2=0x7fe8981596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe898143ee0 0x7fe8981596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 -- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898074860 msgr2=0x7fe898142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898074860 0x7fe898142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.864+0000 7fe896a00640 1 -- 172.21.15.81:0/3890697778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe898143c00 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe896a00640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c450 tx=0x7fe88400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840052d0 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe884005470 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8980c46c0 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884012870 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.865+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe898147eb0 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.866+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8981529f0 con 0x7fe898152610 2024-09-11T01:12:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.867+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe8840035f0 con 0x7fe898152610 2024-09-11T01:12:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.868+0000 7fe88f400640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 0x7fe87807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.868+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe884099b70 con 0x7fe898152610 2024-09-11T01:12:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.869+0000 7fe897400640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 0x7fe87807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.869+0000 7fe897400640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 0x7fe87807a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe888035000 tx=0x7fe888038040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:42.872+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe884061c10 con 0x7fe898152610 2024-09-11T01:12:43.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.060+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe8980c75f0 con 0x7fe878077f70 2024-09-11T01:12:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.061+0000 7fe88f400640 1 -- 172.21.15.81:0/3890697778 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8980c75f0 con 0x7fe878077f70 2024-09-11T01:12:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T01:12:43.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 msgr2=0x7fe87807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 0x7fe87807a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe888035000 tx=0x7fe888038040 comp rx=0 tx=0).stop 2024-09-11T01:12:43.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 msgr2=0x7fe898143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c450 tx=0x7fe88400c910 comp rx=0 tx=0).stop 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 shutdown_connections 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe878077f70 0x7fe87807a430 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe898143ee0 0x7fe8981596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe898152610 0x7fe898143310 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 --2- 172.21.15.81:0/3890697778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898074860 0x7fe898142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.063+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 >> 172.21.15.81:0/3890697778 conn(0x7fe8980700f0 msgr2=0x7fe8980c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.064+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 shutdown_connections 2024-09-11T01:12:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.064+0000 7fe89e000640 1 -- 172.21.15.81:0/3890697778 wait complete. 2024-09-11T01:12:43.083 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T01:12:43.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 -- 172.21.15.81:0/996829913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 msgr2=0x7fd3000725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 --2- 172.21.15.81:0/996829913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd3000725c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd30006dcc0 tx=0x7fd2ec02a680 comp rx=0 tx=0).stop 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 -- 172.21.15.81:0/996829913 shutdown_connections 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 --2- 172.21.15.81:0/996829913 >> v2:172.21.15.167:3300/0 conn(0x7fd3000c7dd0 0x7fd30006e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 --2- 172.21.15.81:0/996829913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd3000725c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 -- 172.21.15.81:0/996829913 >> 172.21.15.81:0/996829913 conn(0x7fd30006ffb0 msgr2=0x7fd3000703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 -- 172.21.15.81:0/996829913 shutdown_connections 2024-09-11T01:12:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.241+0000 7fd307c00640 1 -- 172.21.15.81:0/996829913 wait complete. 2024-09-11T01:12:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.243+0000 7fd307c00640 1 Processor -- start 2024-09-11T01:12:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.243+0000 7fd307c00640 1 -- start start 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd300156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3000c7dd0 0x7fd3001505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd300152880 0x7fd3000c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd30015c820 con 0x7fd300070b80 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd300152c60 con 0x7fd3000c7dd0 2024-09-11T01:12:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd307c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd30015c9a0 con 0x7fd300152880 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd300156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd300156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51032/0 (socket says 172.21.15.81:51032) 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 -- 172.21.15.81:0/2163670165 learned_addr learned my addr 172.21.15.81:0/2163670165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 -- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd300152880 msgr2=0x7fd3000c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd300152880 0x7fd3000c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 -- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3000c7dd0 msgr2=0x7fd3001505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3000c7dd0 0x7fd3001505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.244+0000 7fd305200640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300156970 con 0x7fd300070b80 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd305200640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd300156c30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c730 tx=0x7fd2f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0003b70 con 0x7fd300070b80 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f0003d30 con 0x7fd300070b80 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000aab0 con 0x7fd300070b80 2024-09-11T01:12:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001f4720 con 0x7fd300070b80 2024-09-11T01:12:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.245+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3000cb820 con 0x7fd300070b80 2024-09-11T01:12:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.246+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3000cb640 con 0x7fd300070b80 2024-09-11T01:12:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.247+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd2f000ac50 con 0x7fd300070b80 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.248+0000 7fd2fcc00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd2e0077fa0 0x7fd2e007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.248+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd2f009aa00 con 0x7fd300070b80 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.248+0000 7fd2fcc00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7fd2e0081760 0x7fd2e0083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.248+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2f001fe50 con 0x7fd2e0081760 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.248+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd2f009adb0 con 0x7fd300070b80 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.249+0000 7fd2ffe00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd2e0077fa0 0x7fd2e007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.249+0000 7fd305c00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7fd2e0081760 0x7fd2e0083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.249+0000 7fd305c00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7fd2e0081760 0x7fd2e0083be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.249+0000 7fd2ffe00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd2e0077fa0 0x7fd2e007a460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec033000 tx=0x7fd2ec0046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.250+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== osd.3 v2:172.21.15.81:6801/3351502338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2f001fe50 con 0x7fd2e0081760 2024-09-11T01:12:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.263+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 --> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3000725c0 con 0x7fd2e0081760 2024-09-11T01:12:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.263+0000 7fd2fcc00640 1 -- 172.21.15.81:0/2163670165 <== osd.3 v2:172.21.15.81:6801/3351502338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3000725c0 con 0x7fd2e0081760 2024-09-11T01:12:43.266 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:43.266 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.263+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7fd2e0081760 msgr2=0x7fd2e0083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.263+0000 7fd307c00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:6801/3351502338,v1:172.21.15.81:6803/3351502338] conn(0x7fd2e0081760 0x7fd2e0083be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd2e0077fa0 msgr2=0x7fd2e007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd2e0077fa0 0x7fd2e007a460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec033000 tx=0x7fd2ec0046c0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 msgr2=0x7fd300156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 --2- 172.21.15.81:0/2163670165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300070b80 0x7fd300156c30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c730 tx=0x7fd2f000cbf0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd305c00640 1 -- 172.21.15.81:0/2163670165 reap_dead start 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 shutdown_connections 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 >> 172.21.15.81:0/2163670165 conn(0x7fd30006ffb0 msgr2=0x7fd300158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 shutdown_connections 2024-09-11T01:12:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.264+0000 7fd307c00640 1 -- 172.21.15.81:0/2163670165 wait complete. 2024-09-11T01:12:43.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 -- 172.21.15.81:0/34256605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c0c8680 msgr2=0x7f597c162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 --2- 172.21.15.81:0/34256605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c0c8680 0x7f597c162d90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f597c0769a0 tx=0x7f597402a5c0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 -- 172.21.15.81:0/34256605 shutdown_connections 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 --2- 172.21.15.81:0/34256605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c0c8680 0x7f597c162d90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 --2- 172.21.15.81:0/34256605 >> v2:172.21.15.167:3300/0 conn(0x7f597c152610 0x7f597c0c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 -- 172.21.15.81:0/34256605 >> 172.21.15.81:0/34256605 conn(0x7f597c0700f0 msgr2=0x7f597c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 -- 172.21.15.81:0/34256605 shutdown_connections 2024-09-11T01:12:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.437+0000 7f5982800640 1 -- 172.21.15.81:0/34256605 wait complete. 2024-09-11T01:12:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.439+0000 7f5982800640 1 Processor -- start 2024-09-11T01:12:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.439+0000 7f5982800640 1 -- start start 2024-09-11T01:12:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 0x7f597c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c0af360 0x7f597c0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f597c070cf0 con 0x7f597c152610 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f597c15c140 con 0x7f597c0af360 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f5982800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f597c0c8090 con 0x7f597c074860 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51036/0 (socket says 172.21.15.81:51036) 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 -- 172.21.15.81:0/1126786933 learned_addr learned my addr 172.21.15.81:0/1126786933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597be00640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c0af360 0x7f597c0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597b400640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 0x7f597c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 -- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 msgr2=0x7f597c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 0x7f597c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 -- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c0af360 msgr2=0x7f597c0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c0af360 0x7f597c0af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597aa00640 1 -- 172.21.15.81:0/1126786933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c0cad30 con 0x7f597c152610 2024-09-11T01:12:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.440+0000 7f597b400640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 0x7f597c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f597aa00640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f596800c430 tx=0x7f596800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968011790 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5968017070 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c1e58a0 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968011cc0 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.441+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c1e3ae0 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.442+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597c071b70 con 0x7f597c152610 2024-09-11T01:12:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.443+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f596801c460 con 0x7f597c152610 2024-09-11T01:12:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.445+0000 7f5973400640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 0x7f595c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.445+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f5968099e80 con 0x7f597c152610 2024-09-11T01:12:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.445+0000 7f597b400640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 0x7f595c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.446+0000 7f597b400640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 0x7f595c07a430 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f596c005fd0 tx=0x7f596c009480 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.449+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f597c071b70 con 0x7f597c152610 2024-09-11T01:12:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.630+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f597c1529f0 con 0x7f595c077f70 2024-09-11T01:12:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.631+0000 7f5973400640 1 -- 172.21.15.81:0/1126786933 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f597c1529f0 con 0x7f595c077f70 2024-09-11T01:12:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T01:12:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 msgr2=0x7f595c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 0x7f595c07a430 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f596c005fd0 tx=0x7f596c009480 comp rx=0 tx=0).stop 2024-09-11T01:12:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 msgr2=0x7f597c1e4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f596800c430 tx=0x7f596800c8f0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 shutdown_connections 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f595c077f70 0x7f595c07a430 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c0af360 0x7f597c0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c152610 0x7f597c1e4960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.633+0000 7f5982800640 1 --2- 172.21.15.81:0/1126786933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c074860 0x7f597c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.634+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 >> 172.21.15.81:0/1126786933 conn(0x7f597c0700f0 msgr2=0x7f597c1e2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.634+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 shutdown_connections 2024-09-11T01:12:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.634+0000 7f5982800640 1 -- 172.21.15.81:0/1126786933 wait complete. 2024-09-11T01:12:43.652 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T01:12:43.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 -- 172.21.15.81:0/1789689320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c0c7dd0 msgr2=0x7f836c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 --2- 172.21.15.81:0/1789689320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c0c7dd0 0x7f836c06e750 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f836c0b2410 tx=0x7f836402a5f0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 -- 172.21.15.81:0/1789689320 shutdown_connections 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 --2- 172.21.15.81:0/1789689320 >> v2:172.21.15.167:3300/0 conn(0x7f836c070b80 0x7f836c0725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 --2- 172.21.15.81:0/1789689320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c0c7dd0 0x7f836c06e750 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 -- 172.21.15.81:0/1789689320 >> 172.21.15.81:0/1789689320 conn(0x7f836c06ffb0 msgr2=0x7f836c0703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 -- 172.21.15.81:0/1789689320 shutdown_connections 2024-09-11T01:12:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.812+0000 7f8372200640 1 -- 172.21.15.81:0/1789689320 wait complete. 2024-09-11T01:12:43.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.814+0000 7f8372200640 1 Processor -- start 2024-09-11T01:12:43.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.814+0000 7f8372200640 1 -- start start 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c070b80 0x7f836c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0c7dd0 0x7f836c0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 0x7f836c1e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f836c15c820 con 0x7f836c152880 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f836c152c60 con 0x7f836c0c7dd0 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f8372200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f836c15c9a0 con 0x7f836c070b80 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 0x7f836c1e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 0x7f836c1e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58312/0 (socket says 172.21.15.81:58312) 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 -- 172.21.15.81:0/4248522957 learned_addr learned my addr 172.21.15.81:0/4248522957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836aa00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0c7dd0 0x7f836c0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836b400640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c070b80 0x7f836c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 -- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c070b80 msgr2=0x7f836c1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c070b80 0x7f836c1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 -- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0c7dd0 msgr2=0x7f836c0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0c7dd0 0x7f836c0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.815+0000 7f836be00640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c0c0f50 con 0x7f836c152880 2024-09-11T01:12:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f836be00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 0x7f836c1e2dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8364009230 tx=0x7f8364003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836403f070 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83640047a0 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364035030 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c0c11c0 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.816+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c0c1780 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.817+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f836c073ff0 con 0x7f836c152880 2024-09-11T01:12:43.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.818+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8364004bf0 con 0x7f836c152880 2024-09-11T01:12:43.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.819+0000 7f8363400640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f834c077f70 0x7f834c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.819+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f83640bb150 con 0x7f836c152880 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.819+0000 7f8363400640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f834c081730 0x7f834c083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.819+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f834c084280 con 0x7f834c081730 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.819+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f83640c2050 con 0x7f836c152880 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.820+0000 7f836b400640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f834c077f70 0x7f834c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.820+0000 7f836aa00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f834c081730 0x7f834c083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.820+0000 7f836b400640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f834c077f70 0x7f834c07a430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f835c00b450 tx=0x7f835c00d040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.820+0000 7f836aa00640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f834c081730 0x7f834c083bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.821+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== osd.4 v2:172.21.15.167:6802/2940055079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f834c084280 con 0x7f834c081730 2024-09-11T01:12:43.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.834+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 --> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f836c158200 con 0x7f834c081730 2024-09-11T01:12:43.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.835+0000 7f8363400640 1 -- 172.21.15.81:0/4248522957 <== osd.4 v2:172.21.15.167:6802/2940055079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f836c158200 con 0x7f834c081730 2024-09-11T01:12:43.837 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.835+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f834c081730 msgr2=0x7f834c083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.835+0000 7f8372200640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6802/2940055079,v1:172.21.15.167:6803/2940055079] conn(0x7f834c081730 0x7f834c083bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f834c077f70 msgr2=0x7f834c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f834c077f70 0x7f834c07a430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f835c00b450 tx=0x7f835c00d040 comp rx=0 tx=0).stop 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 msgr2=0x7f836c1e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 --2- 172.21.15.81:0/4248522957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c152880 0x7f836c1e2dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8364009230 tx=0x7f8364003960 comp rx=0 tx=0).stop 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f836be00640 1 -- 172.21.15.81:0/4248522957 reap_dead start 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 shutdown_connections 2024-09-11T01:12:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 >> 172.21.15.81:0/4248522957 conn(0x7f836c06ffb0 msgr2=0x7f836c157200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 shutdown_connections 2024-09-11T01:12:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:43.836+0000 7f8372200640 1 -- 172.21.15.81:0/4248522957 wait complete. 2024-09-11T01:12:43.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 -- 172.21.15.81:0/1072360190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c0c8680 msgr2=0x7fdf4c0c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 --2- 172.21.15.81:0/1072360190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c0c8680 0x7fdf4c0c7ec0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c15c630 tx=0x7fdf4402ab20 comp rx=0 tx=0).stop 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 -- 172.21.15.81:0/1072360190 shutdown_connections 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 --2- 172.21.15.81:0/1072360190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c074860 0x7fdf4c0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 --2- 172.21.15.81:0/1072360190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c0c8680 0x7fdf4c0c7ec0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 -- 172.21.15.81:0/1072360190 >> 172.21.15.81:0/1072360190 conn(0x7fdf4c0700f0 msgr2=0x7fdf4c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 -- 172.21.15.81:0/1072360190 shutdown_connections 2024-09-11T01:12:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.010+0000 7fdf52c00640 1 -- 172.21.15.81:0/1072360190 wait complete. 2024-09-11T01:12:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.012+0000 7fdf52c00640 1 Processor -- start 2024-09-11T01:12:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.012+0000 7fdf52c00640 1 -- start start 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4c074860 0x7fdf4c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c1f4ad0 0x7fdf4c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c070cf0 con 0x7fdf4c152610 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c15c140 con 0x7fdf4c074860 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf52c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4c0c16a0 con 0x7fdf4c1f4ad0 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58334/0 (socket says 172.21.15.81:58334) 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4b400640 1 -- 172.21.15.81:0/3307118848 learned_addr learned my addr 172.21.15.81:0/3307118848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4be00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4c074860 0x7fdf4c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf50c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c1f4ad0 0x7fdf4c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4b400640 1 -- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c1f4ad0 msgr2=0x7fdf4c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.013+0000 7fdf4b400640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c1f4ad0 0x7fdf4c14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf4b400640 1 -- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4c074860 msgr2=0x7fdf4c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf4b400640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4c074860 0x7fdf4c0af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf4b400640 1 -- 172.21.15.81:0/3307118848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c0b0680 con 0x7fdf4c152610 2024-09-11T01:12:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf4b400640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800d6a0 tx=0x7fdf3800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38017070 con 0x7fdf4c152610 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf38009b10 con 0x7fdf4c152610 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c0aff80 con 0x7fdf4c152610 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38010460 con 0x7fdf4c152610 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.014+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c15b320 con 0x7fdf4c152610 2024-09-11T01:12:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.015+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c071b70 con 0x7fdf4c152610 2024-09-11T01:12:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.017+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf38010600 con 0x7fdf4c152610 2024-09-11T01:12:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.018+0000 7fdf43e00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 0x7fdf2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.018+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fdf3809a4e0 con 0x7fdf4c152610 2024-09-11T01:12:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.019+0000 7fdf4be00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 0x7fdf2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.019+0000 7fdf4be00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 0x7fdf2c07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0017c0 tx=0x7fdf3c009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.024+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdf4c071b70 con 0x7fdf4c152610 2024-09-11T01:12:44.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.207+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fdf4c1f5200 con 0x7fdf2c077f70 2024-09-11T01:12:44.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.208+0000 7fdf43e00640 1 -- 172.21.15.81:0/3307118848 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdf3c001460 con 0x7fdf2c077f70 2024-09-11T01:12:44.210 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T01:12:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 msgr2=0x7fdf2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 0x7fdf2c07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0017c0 tx=0x7fdf3c009040 comp rx=0 tx=0).stop 2024-09-11T01:12:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 msgr2=0x7fdf4c1f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800d6a0 tx=0x7fdf3800db60 comp rx=0 tx=0).stop 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 shutdown_connections 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdf2c077f70 0x7fdf2c07a430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf4c1f4ad0 0x7fdf4c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf4c152610 0x7fdf4c1f4590 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 --2- 172.21.15.81:0/3307118848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf4c074860 0x7fdf4c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 >> 172.21.15.81:0/3307118848 conn(0x7fdf4c0700f0 msgr2=0x7fdf4c14e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 shutdown_connections 2024-09-11T01:12:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.211+0000 7fdf52c00640 1 -- 172.21.15.81:0/3307118848 wait complete. 2024-09-11T01:12:44.230 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T01:12:44.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 -- 172.21.15.81:0/4029682683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 msgr2=0x7f2e040c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 --2- 172.21.15.81:0/4029682683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e040c1160 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2e04071a00 tx=0x7f2dfc02aa30 comp rx=0 tx=0).stop 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 -- 172.21.15.81:0/4029682683 shutdown_connections 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 --2- 172.21.15.81:0/4029682683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e040c1160 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 --2- 172.21.15.81:0/4029682683 >> v2:172.21.15.167:3300/0 conn(0x7f2e04151290 0x7f2e04074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 -- 172.21.15.81:0/4029682683 >> 172.21.15.81:0/4029682683 conn(0x7f2e0406c9e0 msgr2=0x7f2e0406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 -- 172.21.15.81:0/4029682683 shutdown_connections 2024-09-11T01:12:44.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.389+0000 7f2e03200640 1 -- 172.21.15.81:0/4029682683 wait complete. 2024-09-11T01:12:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.390+0000 7f2e03200640 1 Processor -- start 2024-09-11T01:12:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 -- start start 2024-09-11T01:12:44.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e041e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e040c2bc0 0x7f2e040b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e04151290 0x7f2e041f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e04072ab0 con 0x7f2e040c26b0 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040748f0 con 0x7f2e04151290 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.391+0000 7f2e03200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2e04072c30 con 0x7f2e040c2bc0 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e041e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e041e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58344/0 (socket says 172.21.15.81:58344) 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 -- 172.21.15.81:0/2023521863 learned_addr learned my addr 172.21.15.81:0/2023521863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01400640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e040c2bc0 0x7f2e040b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e02800640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e04151290 0x7f2e041f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 -- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e040c2bc0 msgr2=0x7f2e040b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e040c2bc0 0x7f2e040b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 -- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e04151290 msgr2=0x7f2e041f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e04151290 0x7f2e041f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e041e34c0 con 0x7f2e040c26b0 2024-09-11T01:12:44.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.392+0000 7f2e01e00640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e041e1310 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d750 tx=0x7f2df400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.393+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4017070 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.393+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2df4004310 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.393+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df400de60 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.393+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e041e37a0 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.393+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e040b0380 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.394+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e041f4780 con 0x7f2e040c26b0 2024-09-11T01:12:44.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.395+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2df4009c30 con 0x7f2e040c26b0 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.396+0000 7f2dfa000640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2de4077f70 0x7f2de407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.396+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f2df409a410 con 0x7f2e040c26b0 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.396+0000 7f2dfa000640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f2de4081730 0x7f2de4083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.396+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2df4019ec0 con 0x7f2de4081730 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.396+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2df40a1050 con 0x7f2e040c26b0 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.397+0000 7f2e01400640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2de4077f70 0x7f2de407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.397+0000 7f2e02800640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f2de4081730 0x7f2de4083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.397+0000 7f2e01400640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2de4077f70 0x7f2de407a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e04157320 tx=0x7f2df0009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.397+0000 7f2e02800640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f2de4081730 0x7f2de4083bb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.398+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== osd.5 v2:172.21.15.167:6818/3209520310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2df4019ec0 con 0x7f2de4081730 2024-09-11T01:12:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.411+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 --> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e041509a0 con 0x7f2de4081730 2024-09-11T01:12:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.412+0000 7f2dfa000640 1 -- 172.21.15.81:0/2023521863 <== osd.5 v2:172.21.15.167:6818/3209520310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2e041509a0 con 0x7f2de4081730 2024-09-11T01:12:44.414 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:44.415 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:44.415 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.412+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f2de4081730 msgr2=0x7f2de4083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.412+0000 7f2e03200640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6818/3209520310,v1:172.21.15.167:6819/3209520310] conn(0x7f2de4081730 0x7f2de4083bb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2de4077f70 msgr2=0x7f2de407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f2de4077f70 0x7f2de407a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e04157320 tx=0x7f2df0009040 comp rx=0 tx=0).stop 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 msgr2=0x7f2e041e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 --2- 172.21.15.81:0/2023521863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e040c26b0 0x7f2e041e1310 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2df400d750 tx=0x7f2df400dc10 comp rx=0 tx=0).stop 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e02800640 1 -- 172.21.15.81:0/2023521863 reap_dead start 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 shutdown_connections 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 >> 172.21.15.81:0/2023521863 conn(0x7f2e0406c9e0 msgr2=0x7f2e0406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 shutdown_connections 2024-09-11T01:12:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.413+0000 7f2e03200640 1 -- 172.21.15.81:0/2023521863 wait complete. 2024-09-11T01:12:44.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T01:12:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.586+0000 7ff94c200640 1 -- 172.21.15.81:0/1873597993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff944074860 msgr2=0x7ff9440c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.586+0000 7ff94c200640 1 --2- 172.21.15.81:0/1873597993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff944074860 0x7ff9440c7980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff94415c630 tx=0x7ff93002a650 comp rx=0 tx=0).stop 2024-09-11T01:12:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 -- 172.21.15.81:0/1873597993 shutdown_connections 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 --2- 172.21.15.81:0/1873597993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff944074860 0x7ff9440c7980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 --2- 172.21.15.81:0/1873597993 >> v2:172.21.15.167:3300/0 conn(0x7ff944152610 0x7ff9440c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 -- 172.21.15.81:0/1873597993 >> 172.21.15.81:0/1873597993 conn(0x7ff9440700f0 msgr2=0x7ff944070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 -- 172.21.15.81:0/1873597993 shutdown_connections 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.587+0000 7ff94c200640 1 -- 172.21.15.81:0/1873597993 wait complete. 2024-09-11T01:12:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.588+0000 7ff94c200640 1 Processor -- start 2024-09-11T01:12:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.588+0000 7ff94c200640 1 -- start start 2024-09-11T01:12:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff944152610 0x7ff944152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9440c4a30 0x7ff944153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff944070cf0 con 0x7ff944074860 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff94415c140 con 0x7ff944152610 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.589+0000 7ff94c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff9441529f0 con 0x7ff9440c4a30 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58356/0 (socket says 172.21.15.81:58356) 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 -- 172.21.15.81:0/1258979680 learned_addr learned my addr 172.21.15.81:0/1258979680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff948e00640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff944152610 0x7ff944152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff94a200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9440c4a30 0x7ff944153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 -- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9440c4a30 msgr2=0x7ff944153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9440c4a30 0x7ff944153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 -- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff944152610 msgr2=0x7ff944152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff944152610 0x7ff944152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 -- 172.21.15.81:0/1258979680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9440c5040 con 0x7ff944074860 2024-09-11T01:12:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.590+0000 7ff949800640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e790 tx=0x7ff93800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.591+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93800eea0 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.591+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff93800cdb0 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.591+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9440c1570 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.591+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938010690 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.591+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9440b09b0 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.592+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9440b22f0 con 0x7ff944074860 2024-09-11T01:12:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.593+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff938010830 con 0x7ff944074860 2024-09-11T01:12:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.594+0000 7ff941600640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 0x7ff92407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.594+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7ff93809aad0 con 0x7ff944074860 2024-09-11T01:12:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.595+0000 7ff948e00640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 0x7ff92407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.595+0000 7ff948e00640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 0x7ff92407a430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff930033000 tx=0x7ff930004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.599+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff9440b22f0 con 0x7ff944074860 2024-09-11T01:12:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.783+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff944071b70 con 0x7ff924077f70 2024-09-11T01:12:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.785+0000 7ff941600640 1 -- 172.21.15.81:0/1258979680 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff944071b70 con 0x7ff924077f70 2024-09-11T01:12:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 msgr2=0x7ff92407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 0x7ff92407a430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff930033000 tx=0x7ff930004730 comp rx=0 tx=0).stop 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 msgr2=0x7ff9440afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e790 tx=0x7ff93800ec50 comp rx=0 tx=0).stop 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 shutdown_connections 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7ff924077f70 0x7ff92407a430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9440c4a30 0x7ff944153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff944152610 0x7ff944152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 --2- 172.21.15.81:0/1258979680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff944074860 0x7ff9440afb80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 >> 172.21.15.81:0/1258979680 conn(0x7ff9440700f0 msgr2=0x7ff94406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 shutdown_connections 2024-09-11T01:12:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.787+0000 7ff94c200640 1 -- 172.21.15.81:0/1258979680 wait complete. 2024-09-11T01:12:44.805 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T01:12:44.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 -- 172.21.15.81:0/3988772574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 msgr2=0x7f70380725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 --2- 172.21.15.81:0/3988772574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380725c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7028005fd0 tx=0x7f702802a660 comp rx=0 tx=0).stop 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 -- 172.21.15.81:0/3988772574 shutdown_connections 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 --2- 172.21.15.81:0/3988772574 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7038070b80 0x7f703815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 --2- 172.21.15.81:0/3988772574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380725c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 -- 172.21.15.81:0/3988772574 >> 172.21.15.81:0/3988772574 conn(0x7f703806ffb0 msgr2=0x7f70380703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 -- 172.21.15.81:0/3988772574 shutdown_connections 2024-09-11T01:12:44.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.963+0000 7f703e000640 1 -- 172.21.15.81:0/3988772574 wait complete. 2024-09-11T01:12:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 Processor -- start 2024-09-11T01:12:44.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 -- start start 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7038070b80 0x7f70380c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f703815c650 0x7f70380c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f703806ee60 con 0x7f7038152880 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7038152c60 con 0x7f7038070b80 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.965+0000 7f703e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f703806efe0 con 0x7f703815c650 2024-09-11T01:12:44.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58366/0 (socket says 172.21.15.81:58366) 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 -- 172.21.15.81:0/3544947390 learned_addr learned my addr 172.21.15.81:0/3544947390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 -- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f703815c650 msgr2=0x7f70380c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f703815c650 0x7f70380c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 -- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7038070b80 msgr2=0x7f70380c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7038070b80 0x7f70380c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70380b1690 con 0x7f7038152880 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.966+0000 7f7036a00640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380af790 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f702400d770 tx=0x7f702400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.967+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024017070 con 0x7f7038152880 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.967+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7024009d20 con 0x7f7038152880 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.967+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7038151100 con 0x7f7038152880 2024-09-11T01:12:44.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.967+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024004280 con 0x7f7038152880 2024-09-11T01:12:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.967+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70380c1100 con 0x7f7038152880 2024-09-11T01:12:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.968+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70380c17c0 con 0x7f7038152880 2024-09-11T01:12:44.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.969+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f70240035f0 con 0x7f7038152880 2024-09-11T01:12:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f702f400640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7018077fa0 0x7f701807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f702409a250 con 0x7f7038152880 2024-09-11T01:12:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f702f400640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7f7018081760 0x7f7018083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7024016ec0 con 0x7f7018081760 2024-09-11T01:12:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f70240a1050 con 0x7f7038152880 2024-09-11T01:12:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f7037400640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7018077fa0 0x7f701807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.970+0000 7f7037e00640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7f7018081760 0x7f7018083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.971+0000 7f7037400640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7018077fa0 0x7f701807a460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7028033000 tx=0x7f70280046c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.971+0000 7f7037e00640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7f7018081760 0x7f7018083be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.972+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== osd.6 v2:172.21.15.167:6810/3232528016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7024016ec0 con 0x7f7018081760 2024-09-11T01:12:44.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.985+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 --> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f70380c7dd0 con 0x7f7018081760 2024-09-11T01:12:44.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.985+0000 7f702f400640 1 -- 172.21.15.81:0/3544947390 <== osd.6 v2:172.21.15.167:6810/3232528016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f70380c7dd0 con 0x7f7018081760 2024-09-11T01:12:44.988 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:44.988 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:44.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7f7018081760 msgr2=0x7f7018083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6810/3232528016,v1:172.21.15.167:6811/3232528016] conn(0x7f7018081760 0x7f7018083be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7018077fa0 msgr2=0x7f701807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f7018077fa0 0x7f701807a460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7028033000 tx=0x7f70280046c0 comp rx=0 tx=0).stop 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 msgr2=0x7f70380af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 --2- 172.21.15.81:0/3544947390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7038152880 0x7f70380af790 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f702400d770 tx=0x7f702400dc30 comp rx=0 tx=0).stop 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f7037e00640 1 -- 172.21.15.81:0/3544947390 reap_dead start 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 shutdown_connections 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 >> 172.21.15.81:0/3544947390 conn(0x7f703806ffb0 msgr2=0x7f70380c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 shutdown_connections 2024-09-11T01:12:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:44.986+0000 7f703e000640 1 -- 172.21.15.81:0/3544947390 wait complete. 2024-09-11T01:12:45.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T01:12:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 -- 172.21.15.81:0/1828386421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c152610 msgr2=0x7fa15c0c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 --2- 172.21.15.81:0/1828386421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c152610 0x7fa15c0c0f90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa15c06ec00 tx=0x7fa14c02a6c0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 -- 172.21.15.81:0/1828386421 shutdown_connections 2024-09-11T01:12:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 --2- 172.21.15.81:0/1828386421 >> v2:172.21.15.167:3300/0 conn(0x7fa15c074860 0x7fa15c0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 --2- 172.21.15.81:0/1828386421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c152610 0x7fa15c0c0f90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 -- 172.21.15.81:0/1828386421 >> 172.21.15.81:0/1828386421 conn(0x7fa15c0700f0 msgr2=0x7fa15c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 -- 172.21.15.81:0/1828386421 shutdown_connections 2024-09-11T01:12:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.162+0000 7fa161a00640 1 -- 172.21.15.81:0/1828386421 wait complete. 2024-09-11T01:12:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.164+0000 7fa161a00640 1 Processor -- start 2024-09-11T01:12:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.164+0000 7fa161a00640 1 -- start start 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c074860 0x7fa15c1f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa15c152610 0x7fa15c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c070cf0 con 0x7fa15c0aec60 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c15c140 con 0x7fa15c074860 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa161a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c1529f0 con 0x7fa15c152610 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa15b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa15b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58380/0 (socket says 172.21.15.81:58380) 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa15b400640 1 -- 172.21.15.81:0/4158131293 learned_addr learned my addr 172.21.15.81:0/4158131293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa15aa00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c074860 0x7fa15c1f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.165+0000 7fa15a000640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa15c152610 0x7fa15c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 -- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa15c152610 msgr2=0x7fa15c0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa15c152610 0x7fa15c0cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 -- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c074860 msgr2=0x7fa15c1f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c074860 0x7fa15c1f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 -- 172.21.15.81:0/4158131293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c15b4d0 con 0x7fa15c0aec60 2024-09-11T01:12:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa15b400640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c730 tx=0x7fa15400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154016020 con 0x7fa15c0aec60 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa15400ce40 con 0x7fa15c0aec60 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c15b790 con 0x7fa15c0aec60 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154006e60 con 0x7fa15c0aec60 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.166+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c0b0490 con 0x7fa15c0aec60 2024-09-11T01:12:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.168+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c0c2ea0 con 0x7fa15c0aec60 2024-09-11T01:12:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.168+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa154003bf0 con 0x7fa15c0aec60 2024-09-11T01:12:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.169+0000 7fa152a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 0x7fa13c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.170+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fa154099b70 con 0x7fa15c0aec60 2024-09-11T01:12:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.170+0000 7fa15aa00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 0x7fa13c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.171+0000 7fa15aa00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 0x7fa13c07a460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa14c033000 tx=0x7fa14c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.173+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa154020020 con 0x7fa15c0aec60 2024-09-11T01:12:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.356+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fa15c0af650 con 0x7fa13c077fa0 2024-09-11T01:12:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.357+0000 7fa152a00640 1 -- 172.21.15.81:0/4158131293 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa15c0af650 con 0x7fa13c077fa0 2024-09-11T01:12:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 msgr2=0x7fa13c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 0x7fa13c07a460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa14c033000 tx=0x7fa14c004730 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 msgr2=0x7fa15c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c730 tx=0x7fa15400cbf0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 shutdown_connections 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fa13c077fa0 0x7fa13c07a460 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c0aec60 0x7fa15c0af110 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa15c152610 0x7fa15c0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 --2- 172.21.15.81:0/4158131293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c074860 0x7fa15c1f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 >> 172.21.15.81:0/4158131293 conn(0x7fa15c0700f0 msgr2=0x7fa15c151220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 shutdown_connections 2024-09-11T01:12:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.359+0000 7fa161a00640 1 -- 172.21.15.81:0/4158131293 wait complete. 2024-09-11T01:12:45.377 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T01:12:45.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T01:12:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 -- 172.21.15.81:0/996649199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c0eb0 msgr2=0x7f4604070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 --2- 172.21.15.81:0/996649199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c0eb0 0x7f4604070710 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005fd0 tx=0x7f45fc02a5d0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 -- 172.21.15.81:0/996649199 shutdown_connections 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 --2- 172.21.15.81:0/996649199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c0eb0 0x7f4604070710 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 --2- 172.21.15.81:0/996649199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46040c8030 0x7f46040701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 -- 172.21.15.81:0/996649199 >> 172.21.15.81:0/996649199 conn(0x7f460406c9e0 msgr2=0x7f460406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 -- 172.21.15.81:0/996649199 shutdown_connections 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.535+0000 7f4609a00640 1 -- 172.21.15.81:0/996649199 wait complete. 2024-09-11T01:12:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.537+0000 7f4609a00640 1 Processor -- start 2024-09-11T01:12:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.537+0000 7f4609a00640 1 -- start start 2024-09-11T01:12:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46040c0eb0 0x7f46040c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 0x7f4604158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46041548a0 0x7f46040c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f460406fcb0 con 0x7f46040c8030 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f460415b120 con 0x7f46040c0eb0 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4609a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f46040c84f0 con 0x7f46041548a0 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4603400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 0x7f4604158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4603400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 0x7f4604158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58402/0 (socket says 172.21.15.81:58402) 2024-09-11T01:12:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.538+0000 7f4603400640 1 -- 172.21.15.81:0/698724372 learned_addr learned my addr 172.21.15.81:0/698724372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4609000640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46041548a0 0x7f46040c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603e00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46040c0eb0 0x7f46040c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 -- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46041548a0 msgr2=0x7f46040c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46041548a0 0x7f46040c1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 -- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46040c0eb0 msgr2=0x7f46040c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46040c0eb0 0x7f46040c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46040cc6a0 con 0x7f46040c8030 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603e00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46040c0eb0 0x7f46040c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4603400640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 0x7f4604158d20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d950 tx=0x7f45ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec017070 con 0x7f46040c8030 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45ec009cc0 con 0x7f46040c8030 2024-09-11T01:12:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460414f650 con 0x7f46040c8030 2024-09-11T01:12:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0106c0 con 0x7f46040c8030 2024-09-11T01:12:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.539+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46041f44b0 con 0x7f46040c8030 2024-09-11T01:12:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.540+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46041f4260 con 0x7f46040c8030 2024-09-11T01:12:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.542+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f45ec010860 con 0x7f46040c8030 2024-09-11T01:12:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.542+0000 7f45fbe00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f45e0077f70 0x7f45e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f45ec09aab0 con 0x7f46040c8030 2024-09-11T01:12:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f45fbe00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7f45e0081730 0x7f45e0083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45e0084280 con 0x7f45e0081730 2024-09-11T01:12:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45ec09ae60 con 0x7f46040c8030 2024-09-11T01:12:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f4603e00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f45e0077f70 0x7f45e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.543+0000 7f4609000640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7f45e0081730 0x7f45e0083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.544+0000 7f4603e00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f45e0077f70 0x7f45e007a430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001d10 tx=0x7f45f4009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.544+0000 7f4609000640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7f45e0081730 0x7f45e0083bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.545+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== osd.7 v2:172.21.15.167:6826/2027890560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45e0084280 con 0x7f45e0081730 2024-09-11T01:12:45.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.558+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 --> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f460415a4b0 con 0x7f45e0081730 2024-09-11T01:12:45.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.558+0000 7f45fbe00640 1 -- 172.21.15.81:0/698724372 <== osd.7 v2:172.21.15.167:6826/2027890560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f460415a4b0 con 0x7f45e0081730 2024-09-11T01:12:45.561 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-11T01:12:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T01:12:45.561 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7f45e0081730 msgr2=0x7f45e0083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6826/2027890560,v1:172.21.15.167:6827/2027890560] conn(0x7f45e0081730 0x7f45e0083bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f45e0077f70 msgr2=0x7f45e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f45e0077f70 0x7f45e007a430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001d10 tx=0x7f45f4009040 comp rx=0 tx=0).stop 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 msgr2=0x7f4604158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 --2- 172.21.15.81:0/698724372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46040c8030 0x7f4604158d20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d950 tx=0x7f45ec00de10 comp rx=0 tx=0).stop 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609000640 1 -- 172.21.15.81:0/698724372 reap_dead start 2024-09-11T01:12:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 shutdown_connections 2024-09-11T01:12:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 >> 172.21.15.81:0/698724372 conn(0x7f460406c9e0 msgr2=0x7f460406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 shutdown_connections 2024-09-11T01:12:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.559+0000 7f4609a00640 1 -- 172.21.15.81:0/698724372 wait complete. 2024-09-11T01:12:45.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T01:12:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.734+0000 7fe9ad600640 1 -- 172.21.15.81:0/1287553945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c003a00 msgr2=0x7fe98c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.734+0000 7fe9ad600640 1 --2- 172.21.15.81:0/1287553945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c003a00 0x7fe98c003e20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe998009b50 tx=0x7fe98c005830 comp rx=0 tx=0).stop 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.734+0000 7fe9a7400640 1 -- 172.21.15.81:0/1287553945 reap_dead start 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.735+0000 7fe9ad600640 1 -- 172.21.15.81:0/1287553945 shutdown_connections 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.735+0000 7fe9ad600640 1 -- 172.21.15.81:0/1287553945 >> 172.21.15.81:0/1287553945 conn(0x7fe9a80700f0 msgr2=0x7fe9a8070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.735+0000 7fe9ad600640 1 -- 172.21.15.81:0/1287553945 shutdown_connections 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.735+0000 7fe9ad600640 1 -- 172.21.15.81:0/1287553945 wait complete. 2024-09-11T01:12:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.736+0000 7fe9ad600640 1 Processor -- start 2024-09-11T01:12:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.736+0000 7fe9ad600640 1 -- start start 2024-09-11T01:12:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 0x7fe9a80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a8157c10 0x7fe9a8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8073250 con 0x7fe9a8155460 2024-09-11T01:12:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a815b2f0 con 0x7fe98c003a00 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.737+0000 7fe9ad600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a815a610 con 0x7fe9a8157c10 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58416/0 (socket says 172.21.15.81:58416) 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 -- 172.21.15.81:0/2552059099 learned_addr learned my addr 172.21.15.81:0/2552059099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a6a00640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 0x7fe9a80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a6000640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a8157c10 0x7fe9a8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 -- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a8157c10 msgr2=0x7fe9a8154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a8157c10 0x7fe9a8154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 -- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 msgr2=0x7fe9a80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 0x7fe9a80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 -- 172.21.15.81:0/2552059099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a81f3e50 con 0x7fe9a8155460 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a6a00640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 0x7fe9a80b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe9a7400640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000ee80 con 0x7fe9a8155460 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a0015070 con 0x7fe9a8155460 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.738+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0003ce0 con 0x7fe9a8155460 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.739+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a81f4130 con 0x7fe9a8155460 2024-09-11T01:12:45.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.739+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a81f46f0 con 0x7fe9a8155460 2024-09-11T01:12:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.740+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a8070c60 con 0x7fe9a8155460 2024-09-11T01:12:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.741+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe9a0004030 con 0x7fe9a8155460 2024-09-11T01:12:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.742+0000 7fe99ea00640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 0x7fe98807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.742+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fe9a009ac10 con 0x7fe9a8155460 2024-09-11T01:12:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.742+0000 7fe9a6a00640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 0x7fe98807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.743+0000 7fe9a6a00640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 0x7fe98807a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe998035000 tx=0x7fe99802d040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.745+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe9a0063300 con 0x7fe9a8155460 2024-09-11T01:12:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.930+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fe9a80c6620 con 0x7fe988077f70 2024-09-11T01:12:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.931+0000 7fe99ea00640 1 -- 172.21.15.81:0/2552059099 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9a80c6620 con 0x7fe988077f70 2024-09-11T01:12:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T01:12:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 msgr2=0x7fe98807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 0x7fe98807a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe998035000 tx=0x7fe99802d040 comp rx=0 tx=0).stop 2024-09-11T01:12:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 msgr2=0x7fe9a81e3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a0010f40 comp rx=0 tx=0).stop 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 shutdown_connections 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fe988077f70 0x7fe98807a430 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8155460 0x7fe9a81e3b40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9a8157c10 0x7fe9a8154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 --2- 172.21.15.81:0/2552059099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c003a00 0x7fe9a80b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 >> 172.21.15.81:0/2552059099 conn(0x7fe9a80700f0 msgr2=0x7fe9a80c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 shutdown_connections 2024-09-11T01:12:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:45.933+0000 7fe9ad600640 1 -- 172.21.15.81:0/2552059099 wait complete. 2024-09-11T01:12:45.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:12:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 -- 172.21.15.81:0/1584368305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f646c003ac0 msgr2=0x7f646c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 --2- 172.21.15.81:0/1584368305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f646c003ac0 0x7f646c003ee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6478009b20 tx=0x7f646c005830 comp rx=0 tx=0).stop 2024-09-11T01:12:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6486800640 1 -- 172.21.15.81:0/1584368305 reap_dead start 2024-09-11T01:12:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 -- 172.21.15.81:0/1584368305 shutdown_connections 2024-09-11T01:12:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 -- 172.21.15.81:0/1584368305 >> 172.21.15.81:0/1584368305 conn(0x7f648806ffd0 msgr2=0x7f64880703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 -- 172.21.15.81:0/1584368305 shutdown_connections 2024-09-11T01:12:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.112+0000 7f6487200640 1 -- 172.21.15.81:0/1584368305 wait complete. 2024-09-11T01:12:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.114+0000 7f6487200640 1 Processor -- start 2024-09-11T01:12:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.114+0000 7f6487200640 1 -- start start 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c003ac0 0x7f64881f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 0x7f64881438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6488072510 con 0x7f648814d100 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6488074ee0 con 0x7f646c003ac0 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6487200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f64880727f0 con 0x7f6488143470 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58438/0 (socket says 172.21.15.81:58438) 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 -- 172.21.15.81:0/2188437145 learned_addr learned my addr 172.21.15.81:0/2188437145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485e00640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c003ac0 0x7f64881f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6486800640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 0x7f64881438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 -- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 msgr2=0x7f64881438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 0x7f64881438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 -- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c003ac0 msgr2=0x7f64881f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c003ac0 0x7f64881f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6485400640 1 -- 172.21.15.81:0/2188437145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6488145dc0 con 0x7f648814d100 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.115+0000 7f6486800640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 0x7f64881438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f6485400640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6474011ae0 tx=0x7f6474009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647401e070 con 0x7f648814d100 2024-09-11T01:12:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f647400fe70 con 0x7f648814d100 2024-09-11T01:12:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474004290 con 0x7f648814d100 2024-09-11T01:12:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6488146080 con 0x7f648814d100 2024-09-11T01:12:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.116+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64880c6340 con 0x7f648814d100 2024-09-11T01:12:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.117+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64880b2140 con 0x7f648814d100 2024-09-11T01:12:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.118+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f64740035f0 con 0x7f648814d100 2024-09-11T01:12:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.119+0000 7f647e000640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 0x7f646807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.119+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f647409af40 con 0x7f648814d100 2024-09-11T01:12:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.120+0000 7f6485e00640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 0x7f646807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.121+0000 7f6485e00640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 0x7f646807a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6478035000 tx=0x7f647802d040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.123+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6474063010 con 0x7f648814d100 2024-09-11T01:12:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.307+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64880707c0 con 0x7f6468077f70 2024-09-11T01:12:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.313+0000 7f647e000640 1 -- 172.21.15.81:0/2188437145 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334022 (secure 0 0 0) 0x7f64880707c0 con 0x7f6468077f70 2024-09-11T01:12:46.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:12:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 msgr2=0x7f646807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 0x7f646807a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6478035000 tx=0x7f647802d040 comp rx=0 tx=0).stop 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 msgr2=0x7f648814a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6474011ae0 tx=0x7f6474009e90 comp rx=0 tx=0).stop 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 shutdown_connections 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f6468077f70 0x7f646807a430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6488143470 0x7f64881438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648814d100 0x7f648814a2b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 --2- 172.21.15.81:0/2188437145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c003ac0 0x7f64881f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 >> 172.21.15.81:0/2188437145 conn(0x7f648806ffd0 msgr2=0x7f648814e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 shutdown_connections 2024-09-11T01:12:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:12:46.318+0000 7f6487200640 1 -- 172.21.15.81:0/2188437145 wait complete. 2024-09-11T01:12:46.336 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":883,"stamp":"2024-09-11T01:12:44.338609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16458415,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617528,"num_write_kb":15568566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122314,"ondisk_log_size":122314,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5099712,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5076531,"kb_avail":749875008,"statfs":{"total":773094113280,"available":767872008192,"internally_reserved":0,"allocated":23592960,"data_stored":33910582,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5198368305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-840167769,"num_objects":-301,"num_object_clones":0,"num_object_copies":-1196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-301,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":320,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004123"},"pg_stats":[{"pgid":"2.1f","version":"29'456","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.436277+0000","last_change":"2024-09-11T00:44:16.362157+0000","last_active":"2024-09-11T01:12:32.436277+0000","last_peered":"2024-09-11T01:12:32.436277+0000","last_clean":"2024-09-11T01:12:32.436277+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:32.436277+0000","last_undegraded":"2024-09-11T01:12:32.436277+0000","last_fullsized":"2024-09-11T01:12:32.436277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:58.275852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189978,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180955+0000","last_change":"2024-09-11T00:44:17.345283+0000","last_active":"2024-09-11T01:12:32.180955+0000","last_peered":"2024-09-11T01:12:32.180955+0000","last_clean":"2024-09-11T01:12:32.180955+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:32.180955+0000","last_undegraded":"2024-09-11T01:12:32.180955+0000","last_fullsized":"2024-09-11T01:12:32.180955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4034,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.363576+0000","last_change":"2024-09-11T00:44:21.382152+0000","last_active":"2024-09-11T01:12:30.363576+0000","last_peered":"2024-09-11T01:12:30.363576+0000","last_clean":"2024-09-11T01:12:30.363576+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:30.363576+0000","last_undegraded":"2024-09-11T01:12:30.363576+0000","last_fullsized":"2024-09-11T01:12:30.363576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:30.203533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256931+0000","last_change":"2024-09-11T00:44:16.339922+0000","last_active":"2024-09-11T01:12:30.256931+0000","last_peered":"2024-09-11T01:12:30.256931+0000","last_clean":"2024-09-11T01:12:30.256931+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:30.256931+0000","last_undegraded":"2024-09-11T01:12:30.256931+0000","last_fullsized":"2024-09-11T01:12:30.256931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181533+0000","last_change":"2024-09-11T00:44:17.345835+0000","last_active":"2024-09-11T01:12:32.181533+0000","last_peered":"2024-09-11T01:12:32.181533+0000","last_clean":"2024-09-11T01:12:32.181533+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:32.181533+0000","last_undegraded":"2024-09-11T01:12:32.181533+0000","last_fullsized":"2024-09-11T01:12:32.181533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.346355+0000","last_change":"2024-09-11T00:44:21.383590+0000","last_active":"2024-09-11T01:12:30.346355+0000","last_peered":"2024-09-11T01:12:30.346355+0000","last_clean":"2024-09-11T01:12:30.346355+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:30.346355+0000","last_undegraded":"2024-09-11T01:12:30.346355+0000","last_fullsized":"2024-09-11T01:12:30.346355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.304546+0000","last_change":"2024-09-11T00:44:16.360260+0000","last_active":"2024-09-11T01:12:30.304546+0000","last_peered":"2024-09-11T01:12:30.304546+0000","last_clean":"2024-09-11T01:12:30.304546+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:30.304546+0000","last_undegraded":"2024-09-11T01:12:30.304546+0000","last_fullsized":"2024-09-11T01:12:30.304546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:01.407046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180664+0000","last_change":"2024-09-11T00:44:17.349164+0000","last_active":"2024-09-11T01:12:32.180664+0000","last_peered":"2024-09-11T01:12:32.180664+0000","last_clean":"2024-09-11T01:12:32.180664+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:32.180664+0000","last_undegraded":"2024-09-11T01:12:32.180664+0000","last_fullsized":"2024-09-11T01:12:32.180664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3815,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.340870+0000","last_change":"2024-09-11T00:44:21.386283+0000","last_active":"2024-09-11T01:12:30.340870+0000","last_peered":"2024-09-11T01:12:30.340870+0000","last_clean":"2024-09-11T01:12:30.340870+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:30.340870+0000","last_undegraded":"2024-09-11T01:12:30.340870+0000","last_fullsized":"2024-09-11T01:12:30.340870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:46.284968+0000","last_change":"2024-09-11T00:44:16.360299+0000","last_active":"2024-09-11T01:11:46.284968+0000","last_peered":"2024-09-11T01:11:46.284968+0000","last_clean":"2024-09-11T01:11:46.284968+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:11:46.284968+0000","last_undegraded":"2024-09-11T01:11:46.284968+0000","last_fullsized":"2024-09-11T01:11:46.284968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:24.368287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175684+0000","last_change":"2024-09-11T00:44:17.364062+0000","last_active":"2024-09-11T01:12:32.175684+0000","last_peered":"2024-09-11T01:12:32.175684+0000","last_clean":"2024-09-11T01:12:32.175684+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:32.175684+0000","last_undegraded":"2024-09-11T01:12:32.175684+0000","last_fullsized":"2024-09-11T01:12:32.175684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:44.705895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.313491+0000","last_change":"2024-09-11T00:44:21.386739+0000","last_active":"2024-09-11T01:12:30.313491+0000","last_peered":"2024-09-11T01:12:30.313491+0000","last_clean":"2024-09-11T01:12:30.313491+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:30.313491+0000","last_undegraded":"2024-09-11T01:12:30.313491+0000","last_fullsized":"2024-09-11T01:12:30.313491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166450+0000","last_change":"2024-09-11T00:44:17.351184+0000","last_active":"2024-09-11T01:12:32.166450+0000","last_peered":"2024-09-11T01:12:32.166450+0000","last_clean":"2024-09-11T01:12:32.166450+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:32.166450+0000","last_undegraded":"2024-09-11T01:12:32.166450+0000","last_fullsized":"2024-09-11T01:12:32.166450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:09.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1194","reported_seq":1233,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255776+0000","last_change":"2024-09-11T00:44:16.357609+0000","last_active":"2024-09-11T01:12:30.255776+0000","last_peered":"2024-09-11T01:12:30.255776+0000","last_clean":"2024-09-11T01:12:30.255776+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:30.255776+0000","last_undegraded":"2024-09-11T01:12:30.255776+0000","last_fullsized":"2024-09-11T01:12:30.255776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:00.498686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.354736+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T01:12:30.354736+0000","last_peered":"2024-09-11T01:12:30.354736+0000","last_clean":"2024-09-11T01:12:30.354736+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:12:30.354736+0000","last_undegraded":"2024-09-11T01:12:30.354736+0000","last_fullsized":"2024-09-11T01:12:30.354736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.158944+0000","last_change":"2024-09-11T00:44:17.356100+0000","last_active":"2024-09-11T01:12:32.158944+0000","last_peered":"2024-09-11T01:12:32.158944+0000","last_clean":"2024-09-11T01:12:32.158944+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:32.158944+0000","last_undegraded":"2024-09-11T01:12:32.158944+0000","last_fullsized":"2024-09-11T01:12:32.158944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216270+0000","last_change":"2024-09-11T00:44:16.346013+0000","last_active":"2024-09-11T01:12:30.216270+0000","last_peered":"2024-09-11T01:12:30.216270+0000","last_clean":"2024-09-11T01:12:30.216270+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:30.216270+0000","last_undegraded":"2024-09-11T01:12:30.216270+0000","last_fullsized":"2024-09-11T01:12:30.216270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:22.022950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3746,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307169+0000","last_change":"2024-09-11T00:44:21.382255+0000","last_active":"2024-09-11T01:12:30.307169+0000","last_peered":"2024-09-11T01:12:30.307169+0000","last_clean":"2024-09-11T01:12:30.307169+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:30.307169+0000","last_undegraded":"2024-09-11T01:12:30.307169+0000","last_fullsized":"2024-09-11T01:12:30.307169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.672219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.161667+0000","last_change":"2024-09-11T00:44:17.344438+0000","last_active":"2024-09-11T01:12:32.161667+0000","last_peered":"2024-09-11T01:12:32.161667+0000","last_clean":"2024-09-11T01:12:32.161667+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:32.161667+0000","last_undegraded":"2024-09-11T01:12:32.161667+0000","last_fullsized":"2024-09-11T01:12:32.161667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:25.985805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.187936+0000","last_change":"2024-09-11T00:44:16.373515+0000","last_active":"2024-09-11T01:12:30.187936+0000","last_peered":"2024-09-11T01:12:30.187936+0000","last_clean":"2024-09-11T01:12:30.187936+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:30.187936+0000","last_undegraded":"2024-09-11T01:12:30.187936+0000","last_fullsized":"2024-09-11T01:12:30.187936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:30.457922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201648+0000","last_change":"2024-09-11T00:44:21.383733+0000","last_active":"2024-09-11T01:12:30.201648+0000","last_peered":"2024-09-11T01:12:30.201648+0000","last_clean":"2024-09-11T01:12:30.201648+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:30.201648+0000","last_undegraded":"2024-09-11T01:12:30.201648+0000","last_fullsized":"2024-09-11T01:12:30.201648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:40.960856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169389+0000","last_change":"2024-09-11T00:44:17.350445+0000","last_active":"2024-09-11T01:12:32.169389+0000","last_peered":"2024-09-11T01:12:32.169389+0000","last_clean":"2024-09-11T01:12:32.169389+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:32.169389+0000","last_undegraded":"2024-09-11T01:12:32.169389+0000","last_fullsized":"2024-09-11T01:12:32.169389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:28.875120+0000","last_change":"2024-09-11T00:44:16.359150+0000","last_active":"2024-09-11T01:12:28.875120+0000","last_peered":"2024-09-11T01:12:28.875120+0000","last_clean":"2024-09-11T01:12:28.875120+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:28.875120+0000","last_undegraded":"2024-09-11T01:12:28.875120+0000","last_fullsized":"2024-09-11T01:12:28.875120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:17.159343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.255530+0000","last_change":"2024-09-11T00:44:57.846986+0000","last_active":"2024-09-11T01:12:30.255530+0000","last_peered":"2024-09-11T01:12:30.255530+0000","last_clean":"2024-09-11T01:12:30.255530+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:30.255530+0000","last_undegraded":"2024-09-11T01:12:30.255530+0000","last_fullsized":"2024-09-11T01:12:30.255530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:48.733442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170735+0000","last_change":"2024-09-11T00:44:17.346055+0000","last_active":"2024-09-11T01:12:32.170735+0000","last_peered":"2024-09-11T01:12:32.170735+0000","last_clean":"2024-09-11T01:12:32.170735+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:32.170735+0000","last_undegraded":"2024-09-11T01:12:32.170735+0000","last_fullsized":"2024-09-11T01:12:32.170735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:07.112225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.250636+0000","last_change":"2024-09-11T00:44:16.366379+0000","last_active":"2024-09-11T01:12:30.250636+0000","last_peered":"2024-09-11T01:12:30.250636+0000","last_clean":"2024-09-11T01:12:30.250636+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:30.250636+0000","last_undegraded":"2024-09-11T01:12:30.250636+0000","last_fullsized":"2024-09-11T01:12:30.250636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:58.059092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.063655+0000","last_change":"2024-09-11T00:44:21.384463+0000","last_active":"2024-09-11T01:12:30.063655+0000","last_peered":"2024-09-11T01:12:30.063655+0000","last_clean":"2024-09-11T01:12:30.063655+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:30.063655+0000","last_undegraded":"2024-09-11T01:12:30.063655+0000","last_fullsized":"2024-09-11T01:12:30.063655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.878116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167346+0000","last_change":"2024-09-11T00:44:17.353077+0000","last_active":"2024-09-11T01:12:32.167346+0000","last_peered":"2024-09-11T01:12:32.167346+0000","last_clean":"2024-09-11T01:12:32.167346+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:32.167346+0000","last_undegraded":"2024-09-11T01:12:32.167346+0000","last_fullsized":"2024-09-11T01:12:32.167346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:15.523138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.834664+0000","last_change":"2024-09-11T00:44:16.366978+0000","last_active":"2024-09-11T01:12:31.834664+0000","last_peered":"2024-09-11T01:12:31.834664+0000","last_clean":"2024-09-11T01:12:31.834664+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:31.834664+0000","last_undegraded":"2024-09-11T01:12:31.834664+0000","last_fullsized":"2024-09-11T01:12:31.834664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:20.067351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4161,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.297988+0000","last_change":"2024-09-11T00:44:21.366923+0000","last_active":"2024-09-11T01:12:30.297988+0000","last_peered":"2024-09-11T01:12:30.297988+0000","last_clean":"2024-09-11T01:12:30.297988+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:30.297988+0000","last_undegraded":"2024-09-11T01:12:30.297988+0000","last_fullsized":"2024-09-11T01:12:30.297988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:51.712922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.163013+0000","last_change":"2024-09-11T00:44:17.354748+0000","last_active":"2024-09-11T01:12:32.163013+0000","last_peered":"2024-09-11T01:12:32.163013+0000","last_clean":"2024-09-11T01:12:32.163013+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:32.163013+0000","last_undegraded":"2024-09-11T01:12:32.163013+0000","last_fullsized":"2024-09-11T01:12:32.163013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:26.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.185446+0000","last_change":"2024-09-11T00:44:16.357372+0000","last_active":"2024-09-11T01:12:30.185446+0000","last_peered":"2024-09-11T01:12:30.185446+0000","last_clean":"2024-09-11T01:12:30.185446+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:30.185446+0000","last_undegraded":"2024-09-11T01:12:30.185446+0000","last_fullsized":"2024-09-11T01:12:30.185446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:09.103491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.300655+0000","last_change":"2024-09-11T00:44:21.370354+0000","last_active":"2024-09-11T01:12:30.300655+0000","last_peered":"2024-09-11T01:12:30.300655+0000","last_clean":"2024-09-11T01:12:30.300655+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:30.300655+0000","last_undegraded":"2024-09-11T01:12:30.300655+0000","last_fullsized":"2024-09-11T01:12:30.300655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:05.779055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174302+0000","last_change":"2024-09-11T00:44:17.351233+0000","last_active":"2024-09-11T01:12:32.174302+0000","last_peered":"2024-09-11T01:12:32.174302+0000","last_clean":"2024-09-11T01:12:32.174302+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:32.174302+0000","last_undegraded":"2024-09-11T01:12:32.174302+0000","last_fullsized":"2024-09-11T01:12:32.174302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.215410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.272321+0000","last_change":"2024-09-11T00:44:16.345468+0000","last_active":"2024-09-11T01:12:30.272321+0000","last_peered":"2024-09-11T01:12:30.272321+0000","last_clean":"2024-09-11T01:12:30.272321+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:30.272321+0000","last_undegraded":"2024-09-11T01:12:30.272321+0000","last_fullsized":"2024-09-11T01:12:30.272321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4028,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.216415+0000","last_change":"2024-09-11T00:44:21.375265+0000","last_active":"2024-09-11T01:12:30.216415+0000","last_peered":"2024-09-11T01:12:30.216415+0000","last_clean":"2024-09-11T01:12:30.216415+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:30.216415+0000","last_undegraded":"2024-09-11T01:12:30.216415+0000","last_fullsized":"2024-09-11T01:12:30.216415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:56.691995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173660+0000","last_change":"2024-09-11T00:44:17.364224+0000","last_active":"2024-09-11T01:12:32.173660+0000","last_peered":"2024-09-11T01:12:32.173660+0000","last_clean":"2024-09-11T01:12:32.173660+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:32.173660+0000","last_undegraded":"2024-09-11T01:12:32.173660+0000","last_fullsized":"2024-09-11T01:12:32.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:03.864293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.246446+0000","last_change":"2024-09-11T00:44:16.353932+0000","last_active":"2024-09-11T01:12:30.246446+0000","last_peered":"2024-09-11T01:12:30.246446+0000","last_clean":"2024-09-11T01:12:30.246446+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:30.246446+0000","last_undegraded":"2024-09-11T01:12:30.246446+0000","last_fullsized":"2024-09-11T01:12:30.246446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:24.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.312745+0000","last_change":"2024-09-11T00:44:21.375036+0000","last_active":"2024-09-11T01:12:30.312745+0000","last_peered":"2024-09-11T01:12:30.312745+0000","last_clean":"2024-09-11T01:12:30.312745+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:30.312745+0000","last_undegraded":"2024-09-11T01:12:30.312745+0000","last_fullsized":"2024-09-11T01:12:30.312745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:53.786736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176246+0000","last_change":"2024-09-11T00:44:17.342064+0000","last_active":"2024-09-11T01:12:32.176246+0000","last_peered":"2024-09-11T01:12:32.176246+0000","last_clean":"2024-09-11T01:12:32.176246+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:32.176246+0000","last_undegraded":"2024-09-11T01:12:32.176246+0000","last_fullsized":"2024-09-11T01:12:32.176246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.860216+0000","last_change":"2024-09-11T00:44:16.340235+0000","last_active":"2024-09-11T01:12:32.860216+0000","last_peered":"2024-09-11T01:12:32.860216+0000","last_clean":"2024-09-11T01:12:32.860216+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:32.860216+0000","last_undegraded":"2024-09-11T01:12:32.860216+0000","last_fullsized":"2024-09-11T01:12:32.860216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:40.791803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4141,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345927+0000","last_change":"2024-09-11T00:44:21.370158+0000","last_active":"2024-09-11T01:12:30.345927+0000","last_peered":"2024-09-11T01:12:30.345927+0000","last_clean":"2024-09-11T01:12:30.345927+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:12:30.345927+0000","last_undegraded":"2024-09-11T01:12:30.345927+0000","last_fullsized":"2024-09-11T01:12:30.345927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.160741+0000","last_change":"2024-09-11T00:44:17.348380+0000","last_active":"2024-09-11T01:12:32.160741+0000","last_peered":"2024-09-11T01:12:32.160741+0000","last_clean":"2024-09-11T01:12:32.160741+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:32.160741+0000","last_undegraded":"2024-09-11T01:12:32.160741+0000","last_fullsized":"2024-09-11T01:12:32.160741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.287905+0000","last_change":"2024-09-11T00:44:16.361386+0000","last_active":"2024-09-11T01:12:30.287905+0000","last_peered":"2024-09-11T01:12:30.287905+0000","last_clean":"2024-09-11T01:12:30.287905+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:30.287905+0000","last_undegraded":"2024-09-11T01:12:30.287905+0000","last_fullsized":"2024-09-11T01:12:30.287905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.167008+0000","last_change":"2024-09-11T00:44:21.384555+0000","last_active":"2024-09-11T01:12:30.167008+0000","last_peered":"2024-09-11T01:12:30.167008+0000","last_clean":"2024-09-11T01:12:30.167008+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:12:30.167008+0000","last_undegraded":"2024-09-11T01:12:30.167008+0000","last_fullsized":"2024-09-11T01:12:30.167008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:01.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176022+0000","last_change":"2024-09-11T00:44:17.339728+0000","last_active":"2024-09-11T01:12:32.176022+0000","last_peered":"2024-09-11T01:12:32.176022+0000","last_clean":"2024-09-11T01:12:32.176022+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:32.176022+0000","last_undegraded":"2024-09-11T01:12:32.176022+0000","last_fullsized":"2024-09-11T01:12:32.176022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:08.017888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:09:14.875043+0000","last_change":"2024-09-11T00:44:16.358316+0000","last_active":"2024-09-11T01:09:14.875043+0000","last_peered":"2024-09-11T01:09:14.875043+0000","last_clean":"2024-09-11T01:09:14.875043+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:09:14.875043+0000","last_undegraded":"2024-09-11T01:09:14.875043+0000","last_fullsized":"2024-09-11T01:09:14.875043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:16.485789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:42.666324+0000","last_change":"2024-09-11T01:12:42.666324+0000","last_active":"2024-09-11T01:12:42.666324+0000","last_peered":"2024-09-11T01:12:42.666324+0000","last_clean":"2024-09-11T01:12:42.666324+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:12:42.666324+0000","last_undegraded":"2024-09-11T01:12:42.666324+0000","last_fullsized":"2024-09-11T01:12:42.666324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_clean_scrub_stamp":"2024-09-11T01:12:42.666220+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:30.928859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3469,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.218838+0000","last_change":"2024-09-11T00:44:21.373105+0000","last_active":"2024-09-11T01:12:30.218838+0000","last_peered":"2024-09-11T01:12:30.218838+0000","last_clean":"2024-09-11T01:12:30.218838+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:12:30.218838+0000","last_undegraded":"2024-09-11T01:12:30.218838+0000","last_fullsized":"2024-09-11T01:12:30.218838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:35.874608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166643+0000","last_change":"2024-09-11T00:44:17.359069+0000","last_active":"2024-09-11T01:12:32.166643+0000","last_peered":"2024-09-11T01:12:32.166643+0000","last_clean":"2024-09-11T01:12:32.166643+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:32.166643+0000","last_undegraded":"2024-09-11T01:12:32.166643+0000","last_fullsized":"2024-09-11T01:12:32.166643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:39.921036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:18.897991+0000","last_change":"2024-09-11T00:44:16.353510+0000","last_active":"2024-09-11T01:11:18.897991+0000","last_peered":"2024-09-11T01:11:18.897991+0000","last_clean":"2024-09-11T01:11:18.897991+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:11:18.897991+0000","last_undegraded":"2024-09-11T01:11:18.897991+0000","last_fullsized":"2024-09-11T01:11:18.897991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:50.105582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3631,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.307081+0000","last_change":"2024-09-11T00:44:21.377727+0000","last_active":"2024-09-11T01:12:30.307081+0000","last_peered":"2024-09-11T01:12:30.307081+0000","last_clean":"2024-09-11T01:12:30.307081+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:30.307081+0000","last_undegraded":"2024-09-11T01:12:30.307081+0000","last_fullsized":"2024-09-11T01:12:30.307081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173027+0000","last_change":"2024-09-11T00:44:17.361085+0000","last_active":"2024-09-11T01:12:32.173027+0000","last_peered":"2024-09-11T01:12:32.173027+0000","last_clean":"2024-09-11T01:12:32.173027+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:32.173027+0000","last_undegraded":"2024-09-11T01:12:32.173027+0000","last_fullsized":"2024-09-11T01:12:32.173027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:17.487776+0000","last_change":"2024-09-11T00:44:16.346511+0000","last_active":"2024-09-11T01:11:17.487776+0000","last_peered":"2024-09-11T01:11:17.487776+0000","last_clean":"2024-09-11T01:11:17.487776+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:11:17.487776+0000","last_undegraded":"2024-09-11T01:11:17.487776+0000","last_fullsized":"2024-09-11T01:11:17.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:29.907553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3590,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.322566+0000","last_change":"2024-09-11T00:44:21.381109+0000","last_active":"2024-09-11T01:12:30.322566+0000","last_peered":"2024-09-11T01:12:30.322566+0000","last_clean":"2024-09-11T01:12:30.322566+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:12:30.322566+0000","last_undegraded":"2024-09-11T01:12:30.322566+0000","last_fullsized":"2024-09-11T01:12:30.322566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:16.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178797+0000","last_change":"2024-09-11T00:44:17.348874+0000","last_active":"2024-09-11T01:12:32.178797+0000","last_peered":"2024-09-11T01:12:32.178797+0000","last_clean":"2024-09-11T01:12:32.178797+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:32.178797+0000","last_undegraded":"2024-09-11T01:12:32.178797+0000","last_fullsized":"2024-09-11T01:12:32.178797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:40.467199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.233378+0000","last_change":"2024-09-11T00:44:16.349311+0000","last_active":"2024-09-11T01:12:30.233378+0000","last_peered":"2024-09-11T01:12:30.233378+0000","last_clean":"2024-09-11T01:12:30.233378+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:30.233378+0000","last_undegraded":"2024-09-11T01:12:30.233378+0000","last_fullsized":"2024-09-11T01:12:30.233378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:19.805743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.210070+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T01:12:30.210070+0000","last_peered":"2024-09-11T01:12:30.210070+0000","last_clean":"2024-09-11T01:12:30.210070+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:12:30.210070+0000","last_undegraded":"2024-09-11T01:12:30.210070+0000","last_fullsized":"2024-09-11T01:12:30.210070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.184097+0000","last_change":"2024-09-11T00:44:17.349598+0000","last_active":"2024-09-11T01:12:32.184097+0000","last_peered":"2024-09-11T01:12:32.184097+0000","last_clean":"2024-09-11T01:12:32.184097+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:32.184097+0000","last_undegraded":"2024-09-11T01:12:32.184097+0000","last_fullsized":"2024-09-11T01:12:32.184097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:05.604349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298932+0000","last_change":"2024-09-11T00:44:16.360053+0000","last_active":"2024-09-11T01:12:30.298932+0000","last_peered":"2024-09-11T01:12:30.298932+0000","last_clean":"2024-09-11T01:12:30.298932+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:30.298932+0000","last_undegraded":"2024-09-11T01:12:30.298932+0000","last_fullsized":"2024-09-11T01:12:30.298932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:08.781442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3473,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.353343+0000","last_change":"2024-09-11T00:44:21.373816+0000","last_active":"2024-09-11T01:12:30.353343+0000","last_peered":"2024-09-11T01:12:30.353343+0000","last_clean":"2024-09-11T01:12:30.353343+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:30.353343+0000","last_undegraded":"2024-09-11T01:12:30.353343+0000","last_fullsized":"2024-09-11T01:12:30.353343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:56.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170446+0000","last_change":"2024-09-11T00:44:17.350390+0000","last_active":"2024-09-11T01:12:32.170446+0000","last_peered":"2024-09-11T01:12:32.170446+0000","last_clean":"2024-09-11T01:12:32.170446+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:32.170446+0000","last_undegraded":"2024-09-11T01:12:32.170446+0000","last_fullsized":"2024-09-11T01:12:32.170446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:28.010686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.257538+0000","last_change":"2024-09-11T00:44:16.349817+0000","last_active":"2024-09-11T01:12:30.257538+0000","last_peered":"2024-09-11T01:12:30.257538+0000","last_clean":"2024-09-11T01:12:30.257538+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:30.257538+0000","last_undegraded":"2024-09-11T01:12:30.257538+0000","last_fullsized":"2024-09-11T01:12:30.257538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:59.655248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267004+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T01:12:30.267004+0000","last_peered":"2024-09-11T01:12:30.267004+0000","last_clean":"2024-09-11T01:12:30.267004+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:12:30.267004+0000","last_undegraded":"2024-09-11T01:12:30.267004+0000","last_fullsized":"2024-09-11T01:12:30.267004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.165269+0000","last_change":"2024-09-11T00:44:17.354219+0000","last_active":"2024-09-11T01:12:32.165269+0000","last_peered":"2024-09-11T01:12:32.165269+0000","last_clean":"2024-09-11T01:12:32.165269+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:32.165269+0000","last_undegraded":"2024-09-11T01:12:32.165269+0000","last_fullsized":"2024-09-11T01:12:32.165269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:26.968399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.244504+0000","last_change":"2024-09-11T00:44:16.365177+0000","last_active":"2024-09-11T01:12:30.244504+0000","last_peered":"2024-09-11T01:12:30.244504+0000","last_clean":"2024-09-11T01:12:30.244504+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:30.244504+0000","last_undegraded":"2024-09-11T01:12:30.244504+0000","last_fullsized":"2024-09-11T01:12:30.244504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:06.909276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.318719+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T01:12:30.318719+0000","last_peered":"2024-09-11T01:12:30.318719+0000","last_clean":"2024-09-11T01:12:30.318719+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:12:30.318719+0000","last_undegraded":"2024-09-11T01:12:30.318719+0000","last_fullsized":"2024-09-11T01:12:30.318719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174988+0000","last_change":"2024-09-11T00:44:17.348153+0000","last_active":"2024-09-11T01:12:32.174988+0000","last_peered":"2024-09-11T01:12:32.174988+0000","last_clean":"2024-09-11T01:12:32.174988+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:32.174988+0000","last_undegraded":"2024-09-11T01:12:32.174988+0000","last_fullsized":"2024-09-11T01:12:32.174988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:50.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.180576+0000","last_change":"2024-09-11T00:44:16.357263+0000","last_active":"2024-09-11T01:12:30.180576+0000","last_peered":"2024-09-11T01:12:30.180576+0000","last_clean":"2024-09-11T01:12:30.180576+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:30.180576+0000","last_undegraded":"2024-09-11T01:12:30.180576+0000","last_fullsized":"2024-09-11T01:12:30.180576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:22.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.348920+0000","last_change":"2024-09-11T00:44:21.374684+0000","last_active":"2024-09-11T01:12:30.348920+0000","last_peered":"2024-09-11T01:12:30.348920+0000","last_clean":"2024-09-11T01:12:30.348920+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:30.348920+0000","last_undegraded":"2024-09-11T01:12:30.348920+0000","last_fullsized":"2024-09-11T01:12:30.348920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:28.496515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164904+0000","last_change":"2024-09-11T00:44:17.357101+0000","last_active":"2024-09-11T01:12:32.164904+0000","last_peered":"2024-09-11T01:12:32.164904+0000","last_clean":"2024-09-11T01:12:32.164904+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:32.164904+0000","last_undegraded":"2024-09-11T01:12:32.164904+0000","last_fullsized":"2024-09-11T01:12:32.164904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.256368+0000","last_change":"2024-09-11T00:44:16.363500+0000","last_active":"2024-09-11T01:12:30.256368+0000","last_peered":"2024-09-11T01:12:30.256368+0000","last_clean":"2024-09-11T01:12:30.256368+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:30.256368+0000","last_undegraded":"2024-09-11T01:12:30.256368+0000","last_fullsized":"2024-09-11T01:12:30.256368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:24.299133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3514,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.053069+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T01:12:30.053069+0000","last_peered":"2024-09-11T01:12:30.053069+0000","last_clean":"2024-09-11T01:12:30.053069+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:12:30.053069+0000","last_undegraded":"2024-09-11T01:12:30.053069+0000","last_fullsized":"2024-09-11T01:12:30.053069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172462+0000","last_change":"2024-09-11T00:44:17.351945+0000","last_active":"2024-09-11T01:12:32.172462+0000","last_peered":"2024-09-11T01:12:32.172462+0000","last_clean":"2024-09-11T01:12:32.172462+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:32.172462+0000","last_undegraded":"2024-09-11T01:12:32.172462+0000","last_fullsized":"2024-09-11T01:12:32.172462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'367","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.252206+0000","last_change":"2024-09-11T00:44:16.350091+0000","last_active":"2024-09-11T01:12:30.252206+0000","last_peered":"2024-09-11T01:12:30.252206+0000","last_clean":"2024-09-11T01:12:30.252206+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:30.252206+0000","last_undegraded":"2024-09-11T01:12:30.252206+0000","last_fullsized":"2024-09-11T01:12:30.252206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:43.165844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3580,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.134688+0000","last_change":"2024-09-11T00:44:21.374541+0000","last_active":"2024-09-11T01:12:30.134688+0000","last_peered":"2024-09-11T01:12:30.134688+0000","last_clean":"2024-09-11T01:12:30.134688+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:30.134688+0000","last_undegraded":"2024-09-11T01:12:30.134688+0000","last_fullsized":"2024-09-11T01:12:30.134688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:08.896068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178305+0000","last_change":"2024-09-11T00:44:17.350721+0000","last_active":"2024-09-11T01:12:32.178305+0000","last_peered":"2024-09-11T01:12:32.178305+0000","last_clean":"2024-09-11T01:12:32.178305+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:32.178305+0000","last_undegraded":"2024-09-11T01:12:32.178305+0000","last_fullsized":"2024-09-11T01:12:32.178305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.825233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:31.863603+0000","last_change":"2024-09-11T00:44:16.352951+0000","last_active":"2024-09-11T01:12:31.863603+0000","last_peered":"2024-09-11T01:12:31.863603+0000","last_clean":"2024-09-11T01:12:31.863603+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:31.863603+0000","last_undegraded":"2024-09-11T01:12:31.863603+0000","last_fullsized":"2024-09-11T01:12:31.863603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:35.410355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3760,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.345509+0000","last_change":"2024-09-11T00:44:21.376159+0000","last_active":"2024-09-11T01:12:30.345509+0000","last_peered":"2024-09-11T01:12:30.345509+0000","last_clean":"2024-09-11T01:12:30.345509+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:30.345509+0000","last_undegraded":"2024-09-11T01:12:30.345509+0000","last_fullsized":"2024-09-11T01:12:30.345509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:59.187191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177439+0000","last_change":"2024-09-11T00:44:17.353921+0000","last_active":"2024-09-11T01:12:32.177439+0000","last_peered":"2024-09-11T01:12:32.177439+0000","last_clean":"2024-09-11T01:12:32.177439+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:32.177439+0000","last_undegraded":"2024-09-11T01:12:32.177439+0000","last_fullsized":"2024-09-11T01:12:32.177439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.145668+0000","last_change":"2024-09-11T00:44:16.367208+0000","last_active":"2024-09-11T01:12:30.145668+0000","last_peered":"2024-09-11T01:12:30.145668+0000","last_clean":"2024-09-11T01:12:30.145668+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:30.145668+0000","last_undegraded":"2024-09-11T01:12:30.145668+0000","last_fullsized":"2024-09-11T01:12:30.145668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.141566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.201774+0000","last_change":"2024-09-11T00:44:21.380618+0000","last_active":"2024-09-11T01:12:30.201774+0000","last_peered":"2024-09-11T01:12:30.201774+0000","last_clean":"2024-09-11T01:12:30.201774+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:30.201774+0000","last_undegraded":"2024-09-11T01:12:30.201774+0000","last_fullsized":"2024-09-11T01:12:30.201774+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:14.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183382+0000","last_change":"2024-09-11T00:44:17.356827+0000","last_active":"2024-09-11T01:12:32.183382+0000","last_peered":"2024-09-11T01:12:32.183382+0000","last_clean":"2024-09-11T01:12:32.183382+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:32.183382+0000","last_undegraded":"2024-09-11T01:12:32.183382+0000","last_fullsized":"2024-09-11T01:12:32.183382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:11.126196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.671524+0000","last_change":"2024-09-11T01:12:43.671524+0000","last_active":"2024-09-11T01:12:43.671524+0000","last_peered":"2024-09-11T01:12:43.671524+0000","last_clean":"2024-09-11T01:12:43.671524+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:12:43.671524+0000","last_undegraded":"2024-09-11T01:12:43.671524+0000","last_fullsized":"2024-09-11T01:12:43.671524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.671469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:19.723350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4011,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.293685+0000","last_change":"2024-09-11T00:44:21.375834+0000","last_active":"2024-09-11T01:12:30.293685+0000","last_peered":"2024-09-11T01:12:30.293685+0000","last_clean":"2024-09-11T01:12:30.293685+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:30.293685+0000","last_undegraded":"2024-09-11T01:12:30.293685+0000","last_fullsized":"2024-09-11T01:12:30.293685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:28.030502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.341995+0000","last_change":"2024-09-11T00:44:21.388090+0000","last_active":"2024-09-11T01:12:30.341995+0000","last_peered":"2024-09-11T01:12:30.341995+0000","last_clean":"2024-09-11T01:12:30.341995+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:12:30.341995+0000","last_undegraded":"2024-09-11T01:12:30.341995+0000","last_fullsized":"2024-09-11T01:12:30.341995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:26.598837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174011+0000","last_change":"2024-09-11T00:44:17.351902+0000","last_active":"2024-09-11T01:12:32.174011+0000","last_peered":"2024-09-11T01:12:32.174011+0000","last_clean":"2024-09-11T01:12:32.174011+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:32.174011+0000","last_undegraded":"2024-09-11T01:12:32.174011+0000","last_fullsized":"2024-09-11T01:12:32.174011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:28.540423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:29.280855+0000","last_change":"2024-09-11T00:44:16.361889+0000","last_active":"2024-09-11T01:12:29.280855+0000","last_peered":"2024-09-11T01:12:29.280855+0000","last_clean":"2024-09-11T01:12:29.280855+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:29.280855+0000","last_undegraded":"2024-09-11T01:12:29.280855+0000","last_fullsized":"2024-09-11T01:12:29.280855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:25.475795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.279045+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T01:12:30.279045+0000","last_peered":"2024-09-11T01:12:30.279045+0000","last_clean":"2024-09-11T01:12:30.279045+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:12:30.279045+0000","last_undegraded":"2024-09-11T01:12:30.279045+0000","last_fullsized":"2024-09-11T01:12:30.279045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.176842+0000","last_change":"2024-09-11T00:44:17.351323+0000","last_active":"2024-09-11T01:12:32.176842+0000","last_peered":"2024-09-11T01:12:32.176842+0000","last_clean":"2024-09-11T01:12:32.176842+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:32.176842+0000","last_undegraded":"2024-09-11T01:12:32.176842+0000","last_fullsized":"2024-09-11T01:12:32.176842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:10:53.182691+0000","last_change":"2024-09-11T00:44:16.353156+0000","last_active":"2024-09-11T01:10:53.182691+0000","last_peered":"2024-09-11T01:10:53.182691+0000","last_clean":"2024-09-11T01:10:53.182691+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:10:53.182691+0000","last_undegraded":"2024-09-11T01:10:53.182691+0000","last_fullsized":"2024-09-11T01:10:53.182691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:48.584225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267800+0000","last_change":"2024-09-11T00:44:16.359740+0000","last_active":"2024-09-11T01:12:30.267800+0000","last_peered":"2024-09-11T01:12:30.267800+0000","last_clean":"2024-09-11T01:12:30.267800+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:30.267800+0000","last_undegraded":"2024-09-11T01:12:30.267800+0000","last_fullsized":"2024-09-11T01:12:30.267800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.960474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177191+0000","last_change":"2024-09-11T00:44:17.351466+0000","last_active":"2024-09-11T01:12:32.177191+0000","last_peered":"2024-09-11T01:12:32.177191+0000","last_clean":"2024-09-11T01:12:32.177191+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:32.177191+0000","last_undegraded":"2024-09-11T01:12:32.177191+0000","last_fullsized":"2024-09-11T01:12:32.177191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:03.500924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3060,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.022723+0000","last_change":"2024-09-11T00:44:21.376734+0000","last_active":"2024-09-11T01:12:30.022723+0000","last_peered":"2024-09-11T01:12:30.022723+0000","last_clean":"2024-09-11T01:12:30.022723+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:30.022723+0000","last_undegraded":"2024-09-11T01:12:30.022723+0000","last_fullsized":"2024-09-11T01:12:30.022723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:25.653999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'608","reported_seq":646,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:11:47.550566+0000","last_change":"2024-09-11T00:44:16.344627+0000","last_active":"2024-09-11T01:11:47.550566+0000","last_peered":"2024-09-11T01:11:47.550566+0000","last_clean":"2024-09-11T01:11:47.550566+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:11:47.550566+0000","last_undegraded":"2024-09-11T01:11:47.550566+0000","last_fullsized":"2024-09-11T01:11:47.550566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:15.305705+0000","last_clean_scrub_stamp":"2024-09-11T00:44:15.305705+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:41.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180166+0000","last_change":"2024-09-11T00:44:17.353440+0000","last_active":"2024-09-11T01:12:32.180166+0000","last_peered":"2024-09-11T01:12:32.180166+0000","last_clean":"2024-09-11T01:12:32.180166+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:32.180166+0000","last_undegraded":"2024-09-11T01:12:32.180166+0000","last_fullsized":"2024-09-11T01:12:32.180166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.862719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.298969+0000","last_change":"2024-09-11T00:44:21.382808+0000","last_active":"2024-09-11T01:12:30.298969+0000","last_peered":"2024-09-11T01:12:30.298969+0000","last_clean":"2024-09-11T01:12:30.298969+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:30.298969+0000","last_undegraded":"2024-09-11T01:12:30.298969+0000","last_fullsized":"2024-09-11T01:12:30.298969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:30.994680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.167609+0000","last_change":"2024-09-11T00:44:17.360341+0000","last_active":"2024-09-11T01:12:32.167609+0000","last_peered":"2024-09-11T01:12:32.167609+0000","last_clean":"2024-09-11T01:12:32.167609+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:32.167609+0000","last_undegraded":"2024-09-11T01:12:32.167609+0000","last_fullsized":"2024-09-11T01:12:32.167609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:02.414971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.159359+0000","last_change":"2024-09-11T00:44:17.349389+0000","last_active":"2024-09-11T01:12:32.159359+0000","last_peered":"2024-09-11T01:12:32.159359+0000","last_clean":"2024-09-11T01:12:32.159359+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:32.159359+0000","last_undegraded":"2024-09-11T01:12:32.159359+0000","last_fullsized":"2024-09-11T01:12:32.159359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178354+0000","last_change":"2024-09-11T00:44:17.356935+0000","last_active":"2024-09-11T01:12:32.178354+0000","last_peered":"2024-09-11T01:12:32.178354+0000","last_clean":"2024-09-11T01:12:32.178354+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:32.178354+0000","last_undegraded":"2024-09-11T01:12:32.178354+0000","last_fullsized":"2024-09-11T01:12:32.178354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:59.892703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175700+0000","last_change":"2024-09-11T00:44:17.343926+0000","last_active":"2024-09-11T01:12:32.175700+0000","last_peered":"2024-09-11T01:12:32.175700+0000","last_clean":"2024-09-11T01:12:32.175700+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:32.175700+0000","last_undegraded":"2024-09-11T01:12:32.175700+0000","last_fullsized":"2024-09-11T01:12:32.175700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177831+0000","last_change":"2024-09-11T00:44:17.346229+0000","last_active":"2024-09-11T01:12:32.177831+0000","last_peered":"2024-09-11T01:12:32.177831+0000","last_clean":"2024-09-11T01:12:32.177831+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:32.177831+0000","last_undegraded":"2024-09-11T01:12:32.177831+0000","last_fullsized":"2024-09-11T01:12:32.177831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:29.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.152165+0000","last_change":"2024-09-11T00:44:17.348787+0000","last_active":"2024-09-11T01:12:32.152165+0000","last_peered":"2024-09-11T01:12:32.152165+0000","last_clean":"2024-09-11T01:12:32.152165+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:32.152165+0000","last_undegraded":"2024-09-11T01:12:32.152165+0000","last_fullsized":"2024-09-11T01:12:32.152165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:26.967134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.183309+0000","last_change":"2024-09-11T00:44:17.354455+0000","last_active":"2024-09-11T01:12:32.183309+0000","last_peered":"2024-09-11T01:12:32.183309+0000","last_clean":"2024-09-11T01:12:32.183309+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:32.183309+0000","last_undegraded":"2024-09-11T01:12:32.183309+0000","last_fullsized":"2024-09-11T01:12:32.183309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.067017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175313+0000","last_change":"2024-09-11T00:44:17.345554+0000","last_active":"2024-09-11T01:12:32.175313+0000","last_peered":"2024-09-11T01:12:32.175313+0000","last_clean":"2024-09-11T01:12:32.175313+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:32.175313+0000","last_undegraded":"2024-09-11T01:12:32.175313+0000","last_fullsized":"2024-09-11T01:12:32.175313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.178540+0000","last_change":"2024-09-11T00:44:17.358530+0000","last_active":"2024-09-11T01:12:32.178540+0000","last_peered":"2024-09-11T01:12:32.178540+0000","last_clean":"2024-09-11T01:12:32.178540+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:12:32.178540+0000","last_undegraded":"2024-09-11T01:12:32.178540+0000","last_fullsized":"2024-09-11T01:12:32.178540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.179104+0000","last_change":"2024-09-11T00:44:17.338242+0000","last_active":"2024-09-11T01:12:32.179104+0000","last_peered":"2024-09-11T01:12:32.179104+0000","last_clean":"2024-09-11T01:12:32.179104+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:32.179104+0000","last_undegraded":"2024-09-11T01:12:32.179104+0000","last_fullsized":"2024-09-11T01:12:32.179104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.773005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.170124+0000","last_change":"2024-09-11T00:44:17.353520+0000","last_active":"2024-09-11T01:12:32.170124+0000","last_peered":"2024-09-11T01:12:32.170124+0000","last_clean":"2024-09-11T01:12:32.170124+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:32.170124+0000","last_undegraded":"2024-09-11T01:12:32.170124+0000","last_fullsized":"2024-09-11T01:12:32.170124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:01.506611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180410+0000","last_change":"2024-09-11T00:44:17.348185+0000","last_active":"2024-09-11T01:12:32.180410+0000","last_peered":"2024-09-11T01:12:32.180410+0000","last_clean":"2024-09-11T01:12:32.180410+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:32.180410+0000","last_undegraded":"2024-09-11T01:12:32.180410+0000","last_fullsized":"2024-09-11T01:12:32.180410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:30.365252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177471+0000","last_change":"2024-09-11T00:44:17.354627+0000","last_active":"2024-09-11T01:12:32.177471+0000","last_peered":"2024-09-11T01:12:32.177471+0000","last_clean":"2024-09-11T01:12:32.177471+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:32.177471+0000","last_undegraded":"2024-09-11T01:12:32.177471+0000","last_fullsized":"2024-09-11T01:12:32.177471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:05.480098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169364+0000","last_change":"2024-09-11T00:44:17.354070+0000","last_active":"2024-09-11T01:12:32.169364+0000","last_peered":"2024-09-11T01:12:32.169364+0000","last_clean":"2024-09-11T01:12:32.169364+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:12:32.169364+0000","last_undegraded":"2024-09-11T01:12:32.169364+0000","last_fullsized":"2024-09-11T01:12:32.169364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:56.328258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.168873+0000","last_change":"2024-09-11T00:44:17.353059+0000","last_active":"2024-09-11T01:12:32.168873+0000","last_peered":"2024-09-11T01:12:32.168873+0000","last_clean":"2024-09-11T01:12:32.168873+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:32.168873+0000","last_undegraded":"2024-09-11T01:12:32.168873+0000","last_fullsized":"2024-09-11T01:12:32.168873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.174517+0000","last_change":"2024-09-11T00:44:17.366358+0000","last_active":"2024-09-11T01:12:32.174517+0000","last_peered":"2024-09-11T01:12:32.174517+0000","last_clean":"2024-09-11T01:12:32.174517+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:12:32.174517+0000","last_undegraded":"2024-09-11T01:12:32.174517+0000","last_fullsized":"2024-09-11T01:12:32.174517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:29.355540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.171124+0000","last_change":"2024-09-11T00:44:17.349094+0000","last_active":"2024-09-11T01:12:32.171124+0000","last_peered":"2024-09-11T01:12:32.171124+0000","last_clean":"2024-09-11T01:12:32.171124+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:12:32.171124+0000","last_undegraded":"2024-09-11T01:12:32.171124+0000","last_fullsized":"2024-09-11T01:12:32.171124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:26.830603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175872+0000","last_change":"2024-09-11T00:44:17.349989+0000","last_active":"2024-09-11T01:12:32.175872+0000","last_peered":"2024-09-11T01:12:32.175872+0000","last_clean":"2024-09-11T01:12:32.175872+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:32.175872+0000","last_undegraded":"2024-09-11T01:12:32.175872+0000","last_fullsized":"2024-09-11T01:12:32.175872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.155284+0000","last_change":"2024-09-11T00:44:17.352968+0000","last_active":"2024-09-11T01:12:32.155284+0000","last_peered":"2024-09-11T01:12:32.155284+0000","last_clean":"2024-09-11T01:12:32.155284+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:32.155284+0000","last_undegraded":"2024-09-11T01:12:32.155284+0000","last_fullsized":"2024-09-11T01:12:32.155284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:10.111416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.169520+0000","last_change":"2024-09-11T00:44:17.356414+0000","last_active":"2024-09-11T01:12:32.169520+0000","last_peered":"2024-09-11T01:12:32.169520+0000","last_clean":"2024-09-11T01:12:32.169520+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:32.169520+0000","last_undegraded":"2024-09-11T01:12:32.169520+0000","last_fullsized":"2024-09-11T01:12:32.169520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:17.493713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180898+0000","last_change":"2024-09-11T00:44:17.354935+0000","last_active":"2024-09-11T01:12:32.180898+0000","last_peered":"2024-09-11T01:12:32.180898+0000","last_clean":"2024-09-11T01:12:32.180898+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:32.180898+0000","last_undegraded":"2024-09-11T01:12:32.180898+0000","last_fullsized":"2024-09-11T01:12:32.180898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:49.759189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.172147+0000","last_change":"2024-09-11T00:44:17.361380+0000","last_active":"2024-09-11T01:12:32.172147+0000","last_peered":"2024-09-11T01:12:32.172147+0000","last_clean":"2024-09-11T01:12:32.172147+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:32.172147+0000","last_undegraded":"2024-09-11T01:12:32.172147+0000","last_fullsized":"2024-09-11T01:12:32.172147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:52.664448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.181309+0000","last_change":"2024-09-11T00:44:17.355163+0000","last_active":"2024-09-11T01:12:32.181309+0000","last_peered":"2024-09-11T01:12:32.181309+0000","last_clean":"2024-09-11T01:12:32.181309+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:32.181309+0000","last_undegraded":"2024-09-11T01:12:32.181309+0000","last_fullsized":"2024-09-11T01:12:32.181309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:34.850569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166759+0000","last_change":"2024-09-11T00:44:17.351072+0000","last_active":"2024-09-11T01:12:32.166759+0000","last_peered":"2024-09-11T01:12:32.166759+0000","last_clean":"2024-09-11T01:12:32.166759+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:32.166759+0000","last_undegraded":"2024-09-11T01:12:32.166759+0000","last_fullsized":"2024-09-11T01:12:32.166759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:25.037328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.180470+0000","last_change":"2024-09-11T00:44:17.352210+0000","last_active":"2024-09-11T01:12:32.180470+0000","last_peered":"2024-09-11T01:12:32.180470+0000","last_clean":"2024-09-11T01:12:32.180470+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:32.180470+0000","last_undegraded":"2024-09-11T01:12:32.180470+0000","last_fullsized":"2024-09-11T01:12:32.180470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:36.933310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.164129+0000","last_change":"2024-09-11T00:44:57.516134+0000","last_active":"2024-09-11T01:12:32.164129+0000","last_peered":"2024-09-11T01:12:32.164129+0000","last_clean":"2024-09-11T01:12:32.164129+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:32.164129+0000","last_undegraded":"2024-09-11T01:12:32.164129+0000","last_fullsized":"2024-09-11T01:12:32.164129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:01.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175616+0000","last_change":"2024-09-11T00:44:17.334140+0000","last_active":"2024-09-11T01:12:32.175616+0000","last_peered":"2024-09-11T01:12:32.175616+0000","last_clean":"2024-09-11T01:12:32.175616+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:32.175616+0000","last_undegraded":"2024-09-11T01:12:32.175616+0000","last_fullsized":"2024-09-11T01:12:32.175616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:25.376212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177037+0000","last_change":"2024-09-11T00:44:17.363237+0000","last_active":"2024-09-11T01:12:32.177037+0000","last_peered":"2024-09-11T01:12:32.177037+0000","last_clean":"2024-09-11T01:12:32.177037+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:32.177037+0000","last_undegraded":"2024-09-11T01:12:32.177037+0000","last_fullsized":"2024-09-11T01:12:32.177037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:52.192481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.177662+0000","last_change":"2024-09-11T00:44:17.346076+0000","last_active":"2024-09-11T01:12:32.177662+0000","last_peered":"2024-09-11T01:12:32.177662+0000","last_clean":"2024-09-11T01:12:32.177662+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:32.177662+0000","last_undegraded":"2024-09-11T01:12:32.177662+0000","last_fullsized":"2024-09-11T01:12:32.177662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:58.356243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.175993+0000","last_change":"2024-09-11T00:44:17.347345+0000","last_active":"2024-09-11T01:12:32.175993+0000","last_peered":"2024-09-11T01:12:32.175993+0000","last_clean":"2024-09-11T01:12:32.175993+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:32.175993+0000","last_undegraded":"2024-09-11T01:12:32.175993+0000","last_fullsized":"2024-09-11T01:12:32.175993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:38.289071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.166210+0000","last_change":"2024-09-11T00:44:17.357819+0000","last_active":"2024-09-11T01:12:32.166210+0000","last_peered":"2024-09-11T01:12:32.166210+0000","last_clean":"2024-09-11T01:12:32.166210+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:32.166210+0000","last_undegraded":"2024-09-11T01:12:32.166210+0000","last_fullsized":"2024-09-11T01:12:32.166210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:24.468968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:32.173362+0000","last_change":"2024-09-11T00:44:17.355228+0000","last_active":"2024-09-11T01:12:32.173362+0000","last_peered":"2024-09-11T01:12:32.173362+0000","last_clean":"2024-09-11T01:12:32.173362+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:32.173362+0000","last_undegraded":"2024-09-11T01:12:32.173362+0000","last_fullsized":"2024-09-11T01:12:32.173362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:16.313630+0000","last_clean_scrub_stamp":"2024-09-11T00:44:16.313630+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:55.159644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15868047,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3778,"num_write_kb":16856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31736094,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3297,"ondisk_log_size":3297,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509786,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509786,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509786,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7508501,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509785,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574232,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":568254,"kb_avail":93797608,"statfs":{"total":96636764160,"available":96048750592,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":581892549},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509785,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509785,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575195,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7509263,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7384282,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7385044,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:12:46.346 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.346 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.346 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.346 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.347 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.348 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.349 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.350 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.351 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.352 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.353 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.354 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.355 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.356 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-11T00:44:15.305705+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=15, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.357 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.358 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.359 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.360 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.361 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.361 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.361 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-11T00:44:16.313630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:12:46.361 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T01:12:46.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:12:46.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:13:06.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:13:06.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 -- 172.21.15.81:0/2113164842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd57814ebc0 msgr2=0x7fd57806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:06.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 --2- 172.21.15.81:0/2113164842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd57814ebc0 0x7fd57806d450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005fd0 tx=0x7fd56c02a5d0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 -- 172.21.15.81:0/2113164842 shutdown_connections 2024-09-11T01:13:06.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 --2- 172.21.15.81:0/2113164842 >> v2:172.21.15.167:3300/0 conn(0x7fd5780b1f10 0x7fd5780745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 --2- 172.21.15.81:0/2113164842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd57814ebc0 0x7fd57806d450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 -- 172.21.15.81:0/2113164842 >> 172.21.15.81:0/2113164842 conn(0x7fd57806ffd0 msgr2=0x7fd5780703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:06.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 -- 172.21.15.81:0/2113164842 shutdown_connections 2024-09-11T01:13:06.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.531+0000 7fd57e600640 1 -- 172.21.15.81:0/2113164842 wait complete. 2024-09-11T01:13:06.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.533+0000 7fd57e600640 1 Processor -- start 2024-09-11T01:13:06.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.533+0000 7fd57e600640 1 -- start start 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd578074b30 0x7fd5780c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5780b1f10 0x7fd5781e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5780c7040 con 0x7fd57814ebc0 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781581a0 con 0x7fd578074b30 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd57814efa0 con 0x7fd5780b1f10 2024-09-11T01:13:06.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57dc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57dc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35968/0 (socket says 172.21.15.81:35968) 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57dc00640 1 -- 172.21.15.81:0/3676818377 learned_addr learned my addr 172.21.15.81:0/3676818377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd577e00640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5780b1f10 0x7fd5781e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.534+0000 7fd57d200640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd578074b30 0x7fd5780c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 -- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5780b1f10 msgr2=0x7fd5781e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5780b1f10 0x7fd5781e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 -- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd578074b30 msgr2=0x7fd5780c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd578074b30 0x7fd5780c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 -- 172.21.15.81:0/3676818377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5780c33a0 con 0x7fd57814ebc0 2024-09-11T01:13:06.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57dc00640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c7a0 tx=0x7fd57000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570003b70 con 0x7fd57814ebc0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd570003d10 con 0x7fd57814ebc0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57000aab0 con 0x7fd57814ebc0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd578073050 con 0x7fd57814ebc0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.535+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd578074260 con 0x7fd57814ebc0 2024-09-11T01:13:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.536+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57815aef0 con 0x7fd57814ebc0 2024-09-11T01:13:06.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.538+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd57000ac50 con 0x7fd57814ebc0 2024-09-11T01:13:06.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.538+0000 7fd574c00640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 0x7fd55807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:06.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.539+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fd570099e60 con 0x7fd57814ebc0 2024-09-11T01:13:06.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.539+0000 7fd57d200640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 0x7fd55807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:06.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.540+0000 7fd57d200640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 0x7fd55807a430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd56c033000 tx=0x7fd56c004730 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.543+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd5780c33a0 con 0x7fd57814ebc0 2024-09-11T01:13:06.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.723+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd578072df0 con 0x7fd558077f70 2024-09-11T01:13:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.729+0000 7fd574c00640 1 -- 172.21.15.81:0/3676818377 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334594 (secure 0 0 0) 0x7fd56c004340 con 0x7fd558077f70 2024-09-11T01:13:06.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:13:06.738 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 msgr2=0x7fd55807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 0x7fd55807a430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd56c033000 tx=0x7fd56c004730 comp rx=0 tx=0).stop 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 msgr2=0x7fd5780c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c7a0 tx=0x7fd57000cc60 comp rx=0 tx=0).stop 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 shutdown_connections 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fd558077f70 0x7fd55807a430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd57814ebc0 0x7fd5780c50d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5780b1f10 0x7fd5781e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 --2- 172.21.15.81:0/3676818377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd578074b30 0x7fd5780c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 >> 172.21.15.81:0/3676818377 conn(0x7fd57806ffd0 msgr2=0x7fd57814a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 shutdown_connections 2024-09-11T01:13:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:06.734+0000 7fd57e600640 1 -- 172.21.15.81:0/3676818377 wait complete. 2024-09-11T01:13:06.753 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":894,"stamp":"2024-09-11T01:13:06.345323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16458415,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617528,"num_write_kb":15568566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122335,"ondisk_log_size":122335,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5103872,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5080691,"kb_avail":749870848,"statfs":{"total":773094113280,"available":767867748352,"internally_reserved":0,"allocated":23592960,"data_stored":33910582,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5202628145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003762"},"pg_stats":[{"pgid":"2.1f","version":"29'458","reported_seq":506,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.409256+0000","last_change":"2024-09-11T01:12:48.409256+0000","last_active":"2024-09-11T01:12:48.409256+0000","last_peered":"2024-09-11T01:12:48.409256+0000","last_clean":"2024-09-11T01:12:48.409256+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:48.409256+0000","last_undegraded":"2024-09-11T01:12:48.409256+0000","last_fullsized":"2024-09-11T01:12:48.409256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'458","last_scrub_stamp":"2024-09-11T01:12:48.409184+0000","last_deep_scrub":"29'458","last_deep_scrub_stamp":"2024-09-11T01:12:48.409184+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.409184+0000","objects_scrubbed":3,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:35:53.603534+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189978,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.915525+0000","last_change":"2024-09-11T01:12:51.915525+0000","last_active":"2024-09-11T01:12:51.915525+0000","last_peered":"2024-09-11T01:12:51.915525+0000","last_clean":"2024-09-11T01:12:51.915525+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:51.915525+0000","last_undegraded":"2024-09-11T01:12:51.915525+0000","last_fullsized":"2024-09-11T01:12:51.915525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-11T01:12:51.915453+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-11T01:12:51.915453+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.915453+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:22.508820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4042,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.413661+0000","last_change":"2024-09-11T01:12:56.413661+0000","last_active":"2024-09-11T01:12:56.413661+0000","last_peered":"2024-09-11T01:12:56.413661+0000","last_clean":"2024-09-11T01:12:56.413661+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:56.413661+0000","last_undegraded":"2024-09-11T01:12:56.413661+0000","last_fullsized":"2024-09-11T01:12:56.413661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4004","last_scrub_stamp":"2024-09-11T01:12:56.413536+0000","last_deep_scrub":"29'4004","last_deep_scrub_stamp":"2024-09-11T01:12:56.413536+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.413536+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:35.820174+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.849596+0000","last_change":"2024-09-11T01:12:45.849596+0000","last_active":"2024-09-11T01:12:45.849596+0000","last_peered":"2024-09-11T01:12:45.849596+0000","last_clean":"2024-09-11T01:12:45.849596+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:45.849596+0000","last_undegraded":"2024-09-11T01:12:45.849596+0000","last_fullsized":"2024-09-11T01:12:45.849596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-11T01:12:45.849505+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-11T01:12:45.849505+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.849505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:19.566999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.955818+0000","last_change":"2024-09-11T01:12:52.955818+0000","last_active":"2024-09-11T01:12:52.955818+0000","last_peered":"2024-09-11T01:12:52.955818+0000","last_clean":"2024-09-11T01:12:52.955818+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:52.955818+0000","last_undegraded":"2024-09-11T01:12:52.955818+0000","last_fullsized":"2024-09-11T01:12:52.955818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:52.955744+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:52.955744+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.955744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:06.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3937,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.764695+0000","last_change":"2024-09-11T01:12:51.764695+0000","last_active":"2024-09-11T01:12:51.764695+0000","last_peered":"2024-09-11T01:12:51.764695+0000","last_clean":"2024-09-11T01:12:51.764695+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:51.764695+0000","last_undegraded":"2024-09-11T01:12:51.764695+0000","last_fullsized":"2024-09-11T01:12:51.764695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3899","last_scrub_stamp":"2024-09-11T01:12:51.764590+0000","last_deep_scrub":"29'3899","last_deep_scrub_stamp":"2024-09-11T01:12:51.764590+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.764590+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:35.281753+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.164807+0000","last_change":"2024-09-11T01:12:46.164807+0000","last_active":"2024-09-11T01:12:46.164807+0000","last_peered":"2024-09-11T01:12:46.164807+0000","last_clean":"2024-09-11T01:12:46.164807+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:46.164807+0000","last_undegraded":"2024-09-11T01:12:46.164807+0000","last_fullsized":"2024-09-11T01:12:46.164807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:46.164750+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:46.164750+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.164750+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:15.665354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.672254+0000","last_change":"2024-09-11T01:12:49.672254+0000","last_active":"2024-09-11T01:12:49.672254+0000","last_peered":"2024-09-11T01:12:49.672254+0000","last_clean":"2024-09-11T01:12:49.672254+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:49.672254+0000","last_undegraded":"2024-09-11T01:12:49.672254+0000","last_fullsized":"2024-09-11T01:12:49.672254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:49.672142+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:49.672142+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.672142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:38.502372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.749970+0000","last_change":"2024-09-11T01:12:53.749970+0000","last_active":"2024-09-11T01:12:53.749970+0000","last_peered":"2024-09-11T01:12:53.749970+0000","last_clean":"2024-09-11T01:12:53.749970+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:53.749970+0000","last_undegraded":"2024-09-11T01:12:53.749970+0000","last_fullsized":"2024-09-11T01:12:53.749970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3785","last_scrub_stamp":"2024-09-11T01:12:53.749863+0000","last_deep_scrub":"29'3785","last_deep_scrub_stamp":"2024-09-11T01:12:53.749863+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.749863+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:10.033800+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.162654+0000","last_change":"2024-09-11T01:12:45.162654+0000","last_active":"2024-09-11T01:12:45.162654+0000","last_peered":"2024-09-11T01:12:45.162654+0000","last_clean":"2024-09-11T01:12:45.162654+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:12:45.162654+0000","last_undegraded":"2024-09-11T01:12:45.162654+0000","last_fullsized":"2024-09-11T01:12:45.162654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:45.162594+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:45.162594+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.162594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:35.822703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.434750+0000","last_change":"2024-09-11T01:12:58.434750+0000","last_active":"2024-09-11T01:12:58.434750+0000","last_peered":"2024-09-11T01:12:58.434750+0000","last_clean":"2024-09-11T01:12:58.434750+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:58.434750+0000","last_undegraded":"2024-09-11T01:12:58.434750+0000","last_fullsized":"2024-09-11T01:12:58.434750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:58.434645+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:58.434645+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.434645+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.653485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.775936+0000","last_change":"2024-09-11T01:12:52.775936+0000","last_active":"2024-09-11T01:12:52.775936+0000","last_peered":"2024-09-11T01:12:52.775936+0000","last_clean":"2024-09-11T01:12:52.775936+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:52.775936+0000","last_undegraded":"2024-09-11T01:12:52.775936+0000","last_fullsized":"2024-09-11T01:12:52.775936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3167","last_scrub_stamp":"2024-09-11T01:12:52.775844+0000","last_deep_scrub":"29'3167","last_deep_scrub_stamp":"2024-09-11T01:12:52.775844+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.775844+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:48.548603+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.506197+0000","last_change":"2024-09-11T01:12:53.506197+0000","last_active":"2024-09-11T01:12:53.506197+0000","last_peered":"2024-09-11T01:12:53.506197+0000","last_clean":"2024-09-11T01:12:53.506197+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:53.506197+0000","last_undegraded":"2024-09-11T01:12:53.506197+0000","last_fullsized":"2024-09-11T01:12:53.506197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:53.506087+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:53.506087+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.506087+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:24.175112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1196","reported_seq":1243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.605365+0000","last_change":"2024-09-11T01:12:46.605365+0000","last_active":"2024-09-11T01:12:46.605365+0000","last_peered":"2024-09-11T01:12:46.605365+0000","last_clean":"2024-09-11T01:12:46.605365+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:46.605365+0000","last_undegraded":"2024-09-11T01:12:46.605365+0000","last_fullsized":"2024-09-11T01:12:46.605365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1196","last_scrub_stamp":"2024-09-11T01:12:46.605304+0000","last_deep_scrub":"29'1196","last_deep_scrub_stamp":"2024-09-11T01:12:46.605304+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.605304+0000","objects_scrubbed":2,"log_size":1196,"log_dups_size":0,"ondisk_log_size":1196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:43.884542+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.354736+0000","last_change":"2024-09-11T00:44:21.376088+0000","last_active":"2024-09-11T01:12:30.354736+0000","last_peered":"2024-09-11T01:12:30.354736+0000","last_clean":"2024-09-11T01:12:30.354736+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:12:30.354736+0000","last_undegraded":"2024-09-11T01:12:30.354736+0000","last_fullsized":"2024-09-11T01:12:30.354736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:05.211671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.357645+0000","last_change":"2024-09-11T01:12:51.357645+0000","last_active":"2024-09-11T01:12:51.357645+0000","last_peered":"2024-09-11T01:12:51.357645+0000","last_clean":"2024-09-11T01:12:51.357645+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:51.357645+0000","last_undegraded":"2024-09-11T01:12:51.357645+0000","last_fullsized":"2024-09-11T01:12:51.357645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:51.357555+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:51.357555+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.357555+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:03.613151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.200554+0000","last_change":"2024-09-11T01:12:47.200554+0000","last_active":"2024-09-11T01:12:47.200554+0000","last_peered":"2024-09-11T01:12:47.200554+0000","last_clean":"2024-09-11T01:12:47.200554+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:47.200554+0000","last_undegraded":"2024-09-11T01:12:47.200554+0000","last_fullsized":"2024-09-11T01:12:47.200554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:47.200483+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:47.200483+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.200483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:11.499171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3754,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.222298+0000","last_change":"2024-09-11T01:12:58.222298+0000","last_active":"2024-09-11T01:12:58.222298+0000","last_peered":"2024-09-11T01:12:58.222298+0000","last_clean":"2024-09-11T01:12:58.222298+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:58.222298+0000","last_undegraded":"2024-09-11T01:12:58.222298+0000","last_fullsized":"2024-09-11T01:12:58.222298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3715","last_scrub_stamp":"2024-09-11T01:12:58.222191+0000","last_deep_scrub":"29'3715","last_deep_scrub_stamp":"2024-09-11T01:12:58.222191+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.222191+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:15.958664+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.402835+0000","last_change":"2024-09-11T01:12:50.402835+0000","last_active":"2024-09-11T01:12:50.402835+0000","last_peered":"2024-09-11T01:12:50.402835+0000","last_clean":"2024-09-11T01:12:50.402835+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:50.402835+0000","last_undegraded":"2024-09-11T01:12:50.402835+0000","last_fullsized":"2024-09-11T01:12:50.402835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:50.402765+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:50.402765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.402765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:26.759234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.397992+0000","last_change":"2024-09-11T01:12:46.397992+0000","last_active":"2024-09-11T01:12:46.397992+0000","last_peered":"2024-09-11T01:12:46.397992+0000","last_clean":"2024-09-11T01:12:46.397992+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:46.397992+0000","last_undegraded":"2024-09-11T01:12:46.397992+0000","last_fullsized":"2024-09-11T01:12:46.397992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:46.397924+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:46.397924+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.397924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.404988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.431439+0000","last_change":"2024-09-11T01:12:52.431439+0000","last_active":"2024-09-11T01:12:52.431439+0000","last_peered":"2024-09-11T01:12:52.431439+0000","last_clean":"2024-09-11T01:12:52.431439+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:52.431439+0000","last_undegraded":"2024-09-11T01:12:52.431439+0000","last_fullsized":"2024-09-11T01:12:52.431439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4232","last_scrub_stamp":"2024-09-11T01:12:52.431291+0000","last_deep_scrub":"29'4232","last_deep_scrub_stamp":"2024-09-11T01:12:52.431291+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.431291+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:42.070542+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.546905+0000","last_change":"2024-09-11T01:12:50.546905+0000","last_active":"2024-09-11T01:12:50.546905+0000","last_peered":"2024-09-11T01:12:50.546905+0000","last_clean":"2024-09-11T01:12:50.546905+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:50.546905+0000","last_undegraded":"2024-09-11T01:12:50.546905+0000","last_fullsized":"2024-09-11T01:12:50.546905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:50.546812+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:50.546812+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.546812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:00.404581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:42.118320+0000","last_change":"2024-09-11T01:12:42.118320+0000","last_active":"2024-09-11T01:12:42.118320+0000","last_peered":"2024-09-11T01:12:42.118320+0000","last_clean":"2024-09-11T01:12:42.118320+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:42.118320+0000","last_undegraded":"2024-09-11T01:12:42.118320+0000","last_fullsized":"2024-09-11T01:12:42.118320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:42.118251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:42.118251+0000","last_clean_scrub_stamp":"2024-09-11T01:12:42.118251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:02.477107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3427,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.893932+0000","last_change":"2024-09-11T01:12:57.893932+0000","last_active":"2024-09-11T01:12:57.893932+0000","last_peered":"2024-09-11T01:12:57.893932+0000","last_clean":"2024-09-11T01:12:57.893932+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:57.893932+0000","last_undegraded":"2024-09-11T01:12:57.893932+0000","last_fullsized":"2024-09-11T01:12:57.893932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3380","last_scrub_stamp":"2024-09-11T01:12:57.893822+0000","last_deep_scrub":"29'3380","last_deep_scrub_stamp":"2024-09-11T01:12:57.893822+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.893822+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:41.164808+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.426673+0000","last_change":"2024-09-11T01:12:49.426673+0000","last_active":"2024-09-11T01:12:49.426673+0000","last_peered":"2024-09-11T01:12:49.426673+0000","last_clean":"2024-09-11T01:12:49.426673+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:49.426673+0000","last_undegraded":"2024-09-11T01:12:49.426673+0000","last_fullsized":"2024-09-11T01:12:49.426673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2024-09-11T01:12:49.426600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2024-09-11T01:12:49.426600+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.426600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:34.179182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.479136+0000","last_change":"2024-09-11T01:12:52.479136+0000","last_active":"2024-09-11T01:12:52.479136+0000","last_peered":"2024-09-11T01:12:52.479136+0000","last_clean":"2024-09-11T01:12:52.479136+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:52.479136+0000","last_undegraded":"2024-09-11T01:12:52.479136+0000","last_fullsized":"2024-09-11T01:12:52.479136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:52.479026+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:52.479026+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.479026+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:37:16.580592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3592,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.776139+0000","last_change":"2024-09-11T01:12:48.776139+0000","last_active":"2024-09-11T01:12:48.776139+0000","last_peered":"2024-09-11T01:12:48.776139+0000","last_clean":"2024-09-11T01:12:48.776139+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:48.776139+0000","last_undegraded":"2024-09-11T01:12:48.776139+0000","last_fullsized":"2024-09-11T01:12:48.776139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3552","last_scrub_stamp":"2024-09-11T01:12:48.776006+0000","last_deep_scrub":"29'3552","last_deep_scrub_stamp":"2024-09-11T01:12:48.776006+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.776006+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:39.436115+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.408746+0000","last_change":"2024-09-11T01:12:51.408746+0000","last_active":"2024-09-11T01:12:51.408746+0000","last_peered":"2024-09-11T01:12:51.408746+0000","last_clean":"2024-09-11T01:12:51.408746+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:51.408746+0000","last_undegraded":"2024-09-11T01:12:51.408746+0000","last_fullsized":"2024-09-11T01:12:51.408746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:51.408669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:51.408669+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.408669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:16.821389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.358389+0000","last_change":"2024-09-11T01:12:44.358389+0000","last_active":"2024-09-11T01:12:44.358389+0000","last_peered":"2024-09-11T01:12:44.358389+0000","last_clean":"2024-09-11T01:12:44.358389+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:44.358389+0000","last_undegraded":"2024-09-11T01:12:44.358389+0000","last_fullsized":"2024-09-11T01:12:44.358389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'459","last_scrub_stamp":"2024-09-11T01:12:44.358307+0000","last_deep_scrub":"29'459","last_deep_scrub_stamp":"2024-09-11T01:12:44.358307+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.358307+0000","objects_scrubbed":1,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:09.593482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4169,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.381757+0000","last_change":"2024-09-11T01:12:56.381757+0000","last_active":"2024-09-11T01:12:56.381757+0000","last_peered":"2024-09-11T01:12:56.381757+0000","last_clean":"2024-09-11T01:12:56.381757+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:56.381757+0000","last_undegraded":"2024-09-11T01:12:56.381757+0000","last_fullsized":"2024-09-11T01:12:56.381757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4128","last_scrub_stamp":"2024-09-11T01:12:56.381662+0000","last_deep_scrub":"29'4128","last_deep_scrub_stamp":"2024-09-11T01:12:56.381662+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.381662+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:39.895389+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.183225+0000","last_change":"2024-09-11T01:12:53.183225+0000","last_active":"2024-09-11T01:12:53.183225+0000","last_peered":"2024-09-11T01:12:53.183225+0000","last_clean":"2024-09-11T01:12:53.183225+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:53.183225+0000","last_undegraded":"2024-09-11T01:12:53.183225+0000","last_fullsized":"2024-09-11T01:12:53.183225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:53.183143+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:53.183143+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.183143+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.200291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.505490+0000","last_change":"2024-09-11T01:12:51.505490+0000","last_active":"2024-09-11T01:12:51.505490+0000","last_peered":"2024-09-11T01:12:51.505490+0000","last_clean":"2024-09-11T01:12:51.505490+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:51.505490+0000","last_undegraded":"2024-09-11T01:12:51.505490+0000","last_fullsized":"2024-09-11T01:12:51.505490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:51.505393+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:51.505393+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.505393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:42.324230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.116906+0000","last_change":"2024-09-11T01:12:57.116906+0000","last_active":"2024-09-11T01:12:57.116906+0000","last_peered":"2024-09-11T01:12:57.116906+0000","last_clean":"2024-09-11T01:12:57.116906+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:57.116906+0000","last_undegraded":"2024-09-11T01:12:57.116906+0000","last_fullsized":"2024-09-11T01:12:57.116906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3646","last_scrub_stamp":"2024-09-11T01:12:57.116774+0000","last_deep_scrub":"29'3646","last_deep_scrub_stamp":"2024-09-11T01:12:57.116774+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.116774+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:52.889533+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.628793+0000","last_change":"2024-09-11T01:12:44.628793+0000","last_active":"2024-09-11T01:12:44.628793+0000","last_peered":"2024-09-11T01:12:44.628793+0000","last_clean":"2024-09-11T01:12:44.628793+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:44.628793+0000","last_undegraded":"2024-09-11T01:12:44.628793+0000","last_fullsized":"2024-09-11T01:12:44.628793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:44.628736+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:44.628736+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.628736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:49.248388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.837310+0000","last_change":"2024-09-11T01:12:44.837310+0000","last_active":"2024-09-11T01:12:44.837310+0000","last_peered":"2024-09-11T01:12:44.837310+0000","last_clean":"2024-09-11T01:12:44.837310+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:44.837310+0000","last_undegraded":"2024-09-11T01:12:44.837310+0000","last_fullsized":"2024-09-11T01:12:44.837310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:44.837235+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:44.837235+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.837235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:28.354398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4036,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.099187+0000","last_change":"2024-09-11T01:12:56.099187+0000","last_active":"2024-09-11T01:12:56.099187+0000","last_peered":"2024-09-11T01:12:56.099187+0000","last_clean":"2024-09-11T01:12:56.099187+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:56.099187+0000","last_undegraded":"2024-09-11T01:12:56.099187+0000","last_fullsized":"2024-09-11T01:12:56.099187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3996","last_scrub_stamp":"2024-09-11T01:12:56.099086+0000","last_deep_scrub":"29'3996","last_deep_scrub_stamp":"2024-09-11T01:12:56.099086+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.099086+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:39.616249+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.202590+0000","last_change":"2024-09-11T01:12:47.202590+0000","last_active":"2024-09-11T01:12:47.202590+0000","last_peered":"2024-09-11T01:12:47.202590+0000","last_clean":"2024-09-11T01:12:47.202590+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:47.202590+0000","last_undegraded":"2024-09-11T01:12:47.202590+0000","last_fullsized":"2024-09-11T01:12:47.202590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:47.202527+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:47.202527+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.202527+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:42.345696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.610548+0000","last_change":"2024-09-11T01:12:45.610548+0000","last_active":"2024-09-11T01:12:45.610548+0000","last_peered":"2024-09-11T01:12:45.610548+0000","last_clean":"2024-09-11T01:12:45.610548+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:45.610548+0000","last_undegraded":"2024-09-11T01:12:45.610548+0000","last_fullsized":"2024-09-11T01:12:45.610548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:45.610472+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:45.610472+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.610472+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:17.535148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.129127+0000","last_change":"2024-09-11T01:12:58.129127+0000","last_active":"2024-09-11T01:12:58.129127+0000","last_peered":"2024-09-11T01:12:58.129127+0000","last_clean":"2024-09-11T01:12:58.129127+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:58.129127+0000","last_undegraded":"2024-09-11T01:12:58.129127+0000","last_fullsized":"2024-09-11T01:12:58.129127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3638","last_scrub_stamp":"2024-09-11T01:12:58.128993+0000","last_deep_scrub":"29'3638","last_deep_scrub_stamp":"2024-09-11T01:12:58.128993+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.128993+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:14.412930+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.898427+0000","last_change":"2024-09-11T01:12:48.898427+0000","last_active":"2024-09-11T01:12:48.898427+0000","last_peered":"2024-09-11T01:12:48.898427+0000","last_clean":"2024-09-11T01:12:48.898427+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:48.898427+0000","last_undegraded":"2024-09-11T01:12:48.898427+0000","last_fullsized":"2024-09-11T01:12:48.898427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:48.898344+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:48.898344+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.898344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:21.686409+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.372438+0000","last_change":"2024-09-11T01:12:46.372438+0000","last_active":"2024-09-11T01:12:46.372438+0000","last_peered":"2024-09-11T01:12:46.372438+0000","last_clean":"2024-09-11T01:12:46.372438+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:46.372438+0000","last_undegraded":"2024-09-11T01:12:46.372438+0000","last_fullsized":"2024-09-11T01:12:46.372438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-11T01:12:46.372356+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-11T01:12:46.372356+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.372356+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.792276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.118921+0000","last_change":"2024-09-11T01:13:00.118921+0000","last_active":"2024-09-11T01:13:00.118921+0000","last_peered":"2024-09-11T01:13:00.118921+0000","last_clean":"2024-09-11T01:13:00.118921+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:13:00.118921+0000","last_undegraded":"2024-09-11T01:13:00.118921+0000","last_fullsized":"2024-09-11T01:13:00.118921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4109","last_scrub_stamp":"2024-09-11T01:13:00.118814+0000","last_deep_scrub":"29'4109","last_deep_scrub_stamp":"2024-09-11T01:13:00.118814+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.118814+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:32.906879+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.182910+0000","last_change":"2024-09-11T01:12:49.182910+0000","last_active":"2024-09-11T01:12:49.182910+0000","last_peered":"2024-09-11T01:12:49.182910+0000","last_clean":"2024-09-11T01:12:49.182910+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:49.182910+0000","last_undegraded":"2024-09-11T01:12:49.182910+0000","last_fullsized":"2024-09-11T01:12:49.182910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-11T01:12:49.182825+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-11T01:12:49.182825+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.182825+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:24:33.489820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.638487+0000","last_change":"2024-09-11T01:12:43.638487+0000","last_active":"2024-09-11T01:12:43.638487+0000","last_peered":"2024-09-11T01:12:43.638487+0000","last_clean":"2024-09-11T01:12:43.638487+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:43.638487+0000","last_undegraded":"2024-09-11T01:12:43.638487+0000","last_fullsized":"2024-09-11T01:12:43.638487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:43.638394+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:43.638394+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.638394+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:30.768656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.983575+0000","last_change":"2024-09-11T01:13:00.983575+0000","last_active":"2024-09-11T01:13:00.983575+0000","last_peered":"2024-09-11T01:13:00.983575+0000","last_clean":"2024-09-11T01:13:00.983575+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:13:00.983575+0000","last_undegraded":"2024-09-11T01:13:00.983575+0000","last_fullsized":"2024-09-11T01:13:00.983575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3208","last_scrub_stamp":"2024-09-11T01:13:00.983473+0000","last_deep_scrub":"29'3208","last_deep_scrub_stamp":"2024-09-11T01:13:00.983473+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.983473+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:10.841241+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.373065+0000","last_change":"2024-09-11T01:12:52.373065+0000","last_active":"2024-09-11T01:12:52.373065+0000","last_peered":"2024-09-11T01:12:52.373065+0000","last_clean":"2024-09-11T01:12:52.373065+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:52.373065+0000","last_undegraded":"2024-09-11T01:12:52.373065+0000","last_fullsized":"2024-09-11T01:12:52.373065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:52.372960+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:52.372960+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.372960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:45.902728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.613855+0000","last_change":"2024-09-11T01:12:44.613855+0000","last_active":"2024-09-11T01:12:44.613855+0000","last_peered":"2024-09-11T01:12:44.613855+0000","last_clean":"2024-09-11T01:12:44.613855+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:12:44.613855+0000","last_undegraded":"2024-09-11T01:12:44.613855+0000","last_fullsized":"2024-09-11T01:12:44.613855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-09-11T01:12:44.613790+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-09-11T01:12:44.613790+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.613790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.521298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:42.666324+0000","last_change":"2024-09-11T01:12:42.666324+0000","last_active":"2024-09-11T01:12:42.666324+0000","last_peered":"2024-09-11T01:12:42.666324+0000","last_clean":"2024-09-11T01:12:42.666324+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:12:42.666324+0000","last_undegraded":"2024-09-11T01:12:42.666324+0000","last_fullsized":"2024-09-11T01:12:42.666324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_clean_scrub_stamp":"2024-09-11T01:12:42.666220+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:30.928859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:04.375776+0000","last_change":"2024-09-11T01:13:04.375776+0000","last_active":"2024-09-11T01:13:04.375776+0000","last_peered":"2024-09-11T01:13:04.375776+0000","last_clean":"2024-09-11T01:13:04.375776+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:13:04.375776+0000","last_undegraded":"2024-09-11T01:13:04.375776+0000","last_fullsized":"2024-09-11T01:13:04.375776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3437","last_scrub_stamp":"2024-09-11T01:13:04.375669+0000","last_deep_scrub":"29'3437","last_deep_scrub_stamp":"2024-09-11T01:13:04.375669+0000","last_clean_scrub_stamp":"2024-09-11T01:13:04.375669+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:31.561908+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.540017+0000","last_change":"2024-09-11T01:12:54.540017+0000","last_active":"2024-09-11T01:12:54.540017+0000","last_peered":"2024-09-11T01:12:54.540017+0000","last_clean":"2024-09-11T01:12:54.540017+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:54.540017+0000","last_undegraded":"2024-09-11T01:12:54.540017+0000","last_fullsized":"2024-09-11T01:12:54.540017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-11T01:12:54.539946+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-11T01:12:54.539946+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.539946+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:36.588222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.246253+0000","last_change":"2024-09-11T01:12:46.246253+0000","last_active":"2024-09-11T01:12:46.246253+0000","last_peered":"2024-09-11T01:12:46.246253+0000","last_clean":"2024-09-11T01:12:46.246253+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:12:46.246253+0000","last_undegraded":"2024-09-11T01:12:46.246253+0000","last_fullsized":"2024-09-11T01:12:46.246253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:46.246171+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:46.246171+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.246171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:12.122157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3639,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.746762+0000","last_change":"2024-09-11T01:12:49.746762+0000","last_active":"2024-09-11T01:12:49.746762+0000","last_peered":"2024-09-11T01:12:49.746762+0000","last_clean":"2024-09-11T01:12:49.746762+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:49.746762+0000","last_undegraded":"2024-09-11T01:12:49.746762+0000","last_fullsized":"2024-09-11T01:12:49.746762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3599","last_scrub_stamp":"2024-09-11T01:12:49.746662+0000","last_deep_scrub":"29'3599","last_deep_scrub_stamp":"2024-09-11T01:12:49.746662+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.746662+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:22.125292+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.205487+0000","last_change":"2024-09-11T01:12:49.205487+0000","last_active":"2024-09-11T01:12:49.205487+0000","last_peered":"2024-09-11T01:12:49.205487+0000","last_clean":"2024-09-11T01:12:49.205487+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:49.205487+0000","last_undegraded":"2024-09-11T01:12:49.205487+0000","last_fullsized":"2024-09-11T01:12:49.205487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:49.205391+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:49.205391+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.205391+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:44.978150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.871336+0000","last_change":"2024-09-11T01:12:47.871336+0000","last_active":"2024-09-11T01:12:47.871336+0000","last_peered":"2024-09-11T01:12:47.871336+0000","last_clean":"2024-09-11T01:12:47.871336+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:12:47.871336+0000","last_undegraded":"2024-09-11T01:12:47.871336+0000","last_fullsized":"2024-09-11T01:12:47.871336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:47.871242+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:47.871242+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.871242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:33.283232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3598,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:02.020122+0000","last_change":"2024-09-11T01:13:02.020122+0000","last_active":"2024-09-11T01:13:02.020122+0000","last_peered":"2024-09-11T01:13:02.020122+0000","last_clean":"2024-09-11T01:13:02.020122+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:13:02.020122+0000","last_undegraded":"2024-09-11T01:13:02.020122+0000","last_fullsized":"2024-09-11T01:13:02.020122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3559","last_scrub_stamp":"2024-09-11T01:13:02.019900+0000","last_deep_scrub":"29'3559","last_deep_scrub_stamp":"2024-09-11T01:13:02.019900+0000","last_clean_scrub_stamp":"2024-09-11T01:13:02.019900+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:54.037592+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.136785+0000","last_change":"2024-09-11T01:12:51.136785+0000","last_active":"2024-09-11T01:12:51.136785+0000","last_peered":"2024-09-11T01:12:51.136785+0000","last_clean":"2024-09-11T01:12:51.136785+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:51.136785+0000","last_undegraded":"2024-09-11T01:12:51.136785+0000","last_fullsized":"2024-09-11T01:12:51.136785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:51.136698+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:51.136698+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.136698+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:26.880740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.395171+0000","last_change":"2024-09-11T01:12:45.395171+0000","last_active":"2024-09-11T01:12:45.395171+0000","last_peered":"2024-09-11T01:12:45.395171+0000","last_clean":"2024-09-11T01:12:45.395171+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:45.395171+0000","last_undegraded":"2024-09-11T01:12:45.395171+0000","last_fullsized":"2024-09-11T01:12:45.395171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-11T01:12:45.395087+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-11T01:12:45.395087+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.395087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:24.407410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.210070+0000","last_change":"2024-09-11T00:44:21.370266+0000","last_active":"2024-09-11T01:12:30.210070+0000","last_peered":"2024-09-11T01:12:30.210070+0000","last_clean":"2024-09-11T01:12:30.210070+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:12:30.210070+0000","last_undegraded":"2024-09-11T01:12:30.210070+0000","last_fullsized":"2024-09-11T01:12:30.210070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:06.471549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.749865+0000","last_change":"2024-09-11T01:12:54.749865+0000","last_active":"2024-09-11T01:12:54.749865+0000","last_peered":"2024-09-11T01:12:54.749865+0000","last_clean":"2024-09-11T01:12:54.749865+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:54.749865+0000","last_undegraded":"2024-09-11T01:12:54.749865+0000","last_fullsized":"2024-09-11T01:12:54.749865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:54.749790+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:54.749790+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.749790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:30.493832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.125495+0000","last_change":"2024-09-11T01:12:44.125495+0000","last_active":"2024-09-11T01:12:44.125495+0000","last_peered":"2024-09-11T01:12:44.125495+0000","last_clean":"2024-09-11T01:12:44.125495+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:44.125495+0000","last_undegraded":"2024-09-11T01:12:44.125495+0000","last_fullsized":"2024-09-11T01:12:44.125495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:44.125434+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:44.125434+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.125434+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:38.902700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3481,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.637346+0000","last_change":"2024-09-11T01:12:47.637346+0000","last_active":"2024-09-11T01:12:47.637346+0000","last_peered":"2024-09-11T01:12:47.637346+0000","last_clean":"2024-09-11T01:12:47.637346+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:47.637346+0000","last_undegraded":"2024-09-11T01:12:47.637346+0000","last_fullsized":"2024-09-11T01:12:47.637346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3441","last_scrub_stamp":"2024-09-11T01:12:47.637267+0000","last_deep_scrub":"29'3441","last_deep_scrub_stamp":"2024-09-11T01:12:47.637267+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.637267+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:29.355788+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.490863+0000","last_change":"2024-09-11T01:12:55.490863+0000","last_active":"2024-09-11T01:12:55.490863+0000","last_peered":"2024-09-11T01:12:55.490863+0000","last_clean":"2024-09-11T01:12:55.490863+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:55.490863+0000","last_undegraded":"2024-09-11T01:12:55.490863+0000","last_fullsized":"2024-09-11T01:12:55.490863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:55.490758+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:55.490758+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.490758+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:08.132380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.420547+0000","last_change":"2024-09-11T01:12:47.420547+0000","last_active":"2024-09-11T01:12:47.420547+0000","last_peered":"2024-09-11T01:12:47.420547+0000","last_clean":"2024-09-11T01:12:47.420547+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:47.420547+0000","last_undegraded":"2024-09-11T01:12:47.420547+0000","last_fullsized":"2024-09-11T01:12:47.420547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:47.420466+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:47.420466+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.420466+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:25.308126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.267004+0000","last_change":"2024-09-11T00:44:21.384561+0000","last_active":"2024-09-11T01:12:30.267004+0000","last_peered":"2024-09-11T01:12:30.267004+0000","last_clean":"2024-09-11T01:12:30.267004+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:12:30.267004+0000","last_undegraded":"2024-09-11T01:12:30.267004+0000","last_fullsized":"2024-09-11T01:12:30.267004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:07.270381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.670219+0000","last_change":"2024-09-11T01:12:44.670219+0000","last_active":"2024-09-11T01:12:44.670219+0000","last_peered":"2024-09-11T01:12:44.670219+0000","last_clean":"2024-09-11T01:12:44.670219+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:44.670219+0000","last_undegraded":"2024-09-11T01:12:44.670219+0000","last_fullsized":"2024-09-11T01:12:44.670219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:44.670156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:44.670156+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.670156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:24.159459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.134910+0000","last_change":"2024-09-11T01:12:43.134910+0000","last_active":"2024-09-11T01:12:43.134910+0000","last_peered":"2024-09-11T01:12:43.134910+0000","last_clean":"2024-09-11T01:12:43.134910+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:43.134910+0000","last_undegraded":"2024-09-11T01:12:43.134910+0000","last_fullsized":"2024-09-11T01:12:43.134910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:43.134847+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:43.134847+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.134847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:30.258099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.318719+0000","last_change":"2024-09-11T00:44:21.381887+0000","last_active":"2024-09-11T01:12:30.318719+0000","last_peered":"2024-09-11T01:12:30.318719+0000","last_clean":"2024-09-11T01:12:30.318719+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:12:30.318719+0000","last_undegraded":"2024-09-11T01:12:30.318719+0000","last_fullsized":"2024-09-11T01:12:30.318719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:20.299400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.475479+0000","last_change":"2024-09-11T01:12:56.475479+0000","last_active":"2024-09-11T01:12:56.475479+0000","last_peered":"2024-09-11T01:12:56.475479+0000","last_clean":"2024-09-11T01:12:56.475479+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:56.475479+0000","last_undegraded":"2024-09-11T01:12:56.475479+0000","last_fullsized":"2024-09-11T01:12:56.475479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:56.475384+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:56.475384+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.475384+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:56.247268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.571482+0000","last_change":"2024-09-11T01:12:48.571482+0000","last_active":"2024-09-11T01:12:48.571482+0000","last_peered":"2024-09-11T01:12:48.571482+0000","last_clean":"2024-09-11T01:12:48.571482+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:48.571482+0000","last_undegraded":"2024-09-11T01:12:48.571482+0000","last_fullsized":"2024-09-11T01:12:48.571482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:48.571385+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:48.571385+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.571385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:58.700157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3874,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.146603+0000","last_change":"2024-09-11T01:12:59.146603+0000","last_active":"2024-09-11T01:12:59.146603+0000","last_peered":"2024-09-11T01:12:59.146603+0000","last_clean":"2024-09-11T01:12:59.146603+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:59.146603+0000","last_undegraded":"2024-09-11T01:12:59.146603+0000","last_fullsized":"2024-09-11T01:12:59.146603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3835","last_scrub_stamp":"2024-09-11T01:12:59.146505+0000","last_deep_scrub":"29'3835","last_deep_scrub_stamp":"2024-09-11T01:12:59.146505+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.146505+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:34.890547+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.197259+0000","last_change":"2024-09-11T01:12:50.197259+0000","last_active":"2024-09-11T01:12:50.197259+0000","last_peered":"2024-09-11T01:12:50.197259+0000","last_clean":"2024-09-11T01:12:50.197259+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:50.197259+0000","last_undegraded":"2024-09-11T01:12:50.197259+0000","last_fullsized":"2024-09-11T01:12:50.197259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:50.197175+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:50.197175+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.197175+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:57.831144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.345041+0000","last_change":"2024-09-11T01:12:47.345041+0000","last_active":"2024-09-11T01:12:47.345041+0000","last_peered":"2024-09-11T01:12:47.345041+0000","last_clean":"2024-09-11T01:12:47.345041+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:47.345041+0000","last_undegraded":"2024-09-11T01:12:47.345041+0000","last_fullsized":"2024-09-11T01:12:47.345041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-11T01:12:47.344954+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-11T01:12:47.344954+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.344954+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:37.137294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3514,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.053069+0000","last_change":"2024-09-11T00:44:21.386867+0000","last_active":"2024-09-11T01:12:30.053069+0000","last_peered":"2024-09-11T01:12:30.053069+0000","last_clean":"2024-09-11T01:12:30.053069+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:12:30.053069+0000","last_undegraded":"2024-09-11T01:12:30.053069+0000","last_fullsized":"2024-09-11T01:12:30.053069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:55.210164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.195854+0000","last_change":"2024-09-11T01:12:48.195854+0000","last_active":"2024-09-11T01:12:48.195854+0000","last_peered":"2024-09-11T01:12:48.195854+0000","last_clean":"2024-09-11T01:12:48.195854+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:48.195854+0000","last_undegraded":"2024-09-11T01:12:48.195854+0000","last_fullsized":"2024-09-11T01:12:48.195854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:48.195765+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:48.195765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.195765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:56.881174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'370","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.669959+0000","last_change":"2024-09-11T01:12:43.669959+0000","last_active":"2024-09-11T01:12:43.669959+0000","last_peered":"2024-09-11T01:12:43.669959+0000","last_clean":"2024-09-11T01:12:43.669959+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:43.669959+0000","last_undegraded":"2024-09-11T01:12:43.669959+0000","last_fullsized":"2024-09-11T01:12:43.669959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'370","last_scrub_stamp":"2024-09-11T01:12:43.669899+0000","last_deep_scrub":"29'370","last_deep_scrub_stamp":"2024-09-11T01:12:43.669899+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.669899+0000","objects_scrubbed":4,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:20.216294+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3588,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.330977+0000","last_change":"2024-09-11T01:12:58.330977+0000","last_active":"2024-09-11T01:12:58.330977+0000","last_peered":"2024-09-11T01:12:58.330977+0000","last_clean":"2024-09-11T01:12:58.330977+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:58.330977+0000","last_undegraded":"2024-09-11T01:12:58.330977+0000","last_fullsized":"2024-09-11T01:12:58.330977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3549","last_scrub_stamp":"2024-09-11T01:12:58.330880+0000","last_deep_scrub":"29'3549","last_deep_scrub_stamp":"2024-09-11T01:12:58.330880+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.330880+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:06.574851+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.482452+0000","last_change":"2024-09-11T01:12:57.482452+0000","last_active":"2024-09-11T01:12:57.482452+0000","last_peered":"2024-09-11T01:12:57.482452+0000","last_clean":"2024-09-11T01:12:57.482452+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:57.482452+0000","last_undegraded":"2024-09-11T01:12:57.482452+0000","last_fullsized":"2024-09-11T01:12:57.482452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:57.482348+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:57.482348+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.482348+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:12.800580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'37","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.321059+0000","last_change":"2024-09-11T01:12:48.321059+0000","last_active":"2024-09-11T01:12:48.321059+0000","last_peered":"2024-09-11T01:12:48.321059+0000","last_clean":"2024-09-11T01:12:48.321059+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:48.321059+0000","last_undegraded":"2024-09-11T01:12:48.321059+0000","last_fullsized":"2024-09-11T01:12:48.321059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-11T01:12:48.320971+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-11T01:12:48.320971+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.320971+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:52.990755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3768,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.738545+0000","last_change":"2024-09-11T01:12:50.738545+0000","last_active":"2024-09-11T01:12:50.738545+0000","last_peered":"2024-09-11T01:12:50.738545+0000","last_clean":"2024-09-11T01:12:50.738545+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:50.738545+0000","last_undegraded":"2024-09-11T01:12:50.738545+0000","last_fullsized":"2024-09-11T01:12:50.738545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3729","last_scrub_stamp":"2024-09-11T01:12:50.738443+0000","last_deep_scrub":"29'3729","last_deep_scrub_stamp":"2024-09-11T01:12:50.738443+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.738443+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:45.881611+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.946518+0000","last_change":"2024-09-11T01:12:49.946518+0000","last_active":"2024-09-11T01:12:49.946518+0000","last_peered":"2024-09-11T01:12:49.946518+0000","last_clean":"2024-09-11T01:12:49.946518+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:49.946518+0000","last_undegraded":"2024-09-11T01:12:49.946518+0000","last_fullsized":"2024-09-11T01:12:49.946518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:49.946436+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:49.946436+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.946436+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:59.280897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.163580+0000","last_change":"2024-09-11T01:12:50.163580+0000","last_active":"2024-09-11T01:12:50.163580+0000","last_peered":"2024-09-11T01:12:50.163580+0000","last_clean":"2024-09-11T01:12:50.163580+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:50.163580+0000","last_undegraded":"2024-09-11T01:12:50.163580+0000","last_fullsized":"2024-09-11T01:12:50.163580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:50.163462+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:50.163462+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.163462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.447399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3523,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.414059+0000","last_change":"2024-09-11T01:12:55.414059+0000","last_active":"2024-09-11T01:12:55.414059+0000","last_peered":"2024-09-11T01:12:55.414059+0000","last_clean":"2024-09-11T01:12:55.414059+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:55.414059+0000","last_undegraded":"2024-09-11T01:12:55.414059+0000","last_fullsized":"2024-09-11T01:12:55.414059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3484","last_scrub_stamp":"2024-09-11T01:12:55.413964+0000","last_deep_scrub":"29'3484","last_deep_scrub_stamp":"2024-09-11T01:12:55.413964+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.413964+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:00.033617+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.791194+0000","last_change":"2024-09-11T01:12:55.791194+0000","last_active":"2024-09-11T01:12:55.791194+0000","last_peered":"2024-09-11T01:12:55.791194+0000","last_clean":"2024-09-11T01:12:55.791194+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:55.791194+0000","last_undegraded":"2024-09-11T01:12:55.791194+0000","last_fullsized":"2024-09-11T01:12:55.791194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:55.791120+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:55.791120+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.791120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:28.579185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.671524+0000","last_change":"2024-09-11T01:12:43.671524+0000","last_active":"2024-09-11T01:12:43.671524+0000","last_peered":"2024-09-11T01:12:43.671524+0000","last_clean":"2024-09-11T01:12:43.671524+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:12:43.671524+0000","last_undegraded":"2024-09-11T01:12:43.671524+0000","last_fullsized":"2024-09-11T01:12:43.671524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.671469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:19.723350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4019,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.368784+0000","last_change":"2024-09-11T01:12:57.368784+0000","last_active":"2024-09-11T01:12:57.368784+0000","last_peered":"2024-09-11T01:12:57.368784+0000","last_clean":"2024-09-11T01:12:57.368784+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:57.368784+0000","last_undegraded":"2024-09-11T01:12:57.368784+0000","last_fullsized":"2024-09-11T01:12:57.368784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3980","last_scrub_stamp":"2024-09-11T01:12:57.368670+0000","last_deep_scrub":"29'3980","last_deep_scrub_stamp":"2024-09-11T01:12:57.368670+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.368670+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:46.771596+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4361,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.301395+0000","last_change":"2024-09-11T01:13:00.301395+0000","last_active":"2024-09-11T01:13:00.301395+0000","last_peered":"2024-09-11T01:13:00.301395+0000","last_clean":"2024-09-11T01:13:00.301395+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:13:00.301395+0000","last_undegraded":"2024-09-11T01:13:00.301395+0000","last_fullsized":"2024-09-11T01:13:00.301395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4320","last_scrub_stamp":"2024-09-11T01:13:00.301295+0000","last_deep_scrub":"29'4320","last_deep_scrub_stamp":"2024-09-11T01:13:00.301295+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.301295+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:26.936275+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.397261+0000","last_change":"2024-09-11T01:12:53.397261+0000","last_active":"2024-09-11T01:12:53.397261+0000","last_peered":"2024-09-11T01:12:53.397261+0000","last_clean":"2024-09-11T01:12:53.397261+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:53.397261+0000","last_undegraded":"2024-09-11T01:12:53.397261+0000","last_fullsized":"2024-09-11T01:12:53.397261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:53.397175+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:53.397175+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.397175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:41.647653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.595649+0000","last_change":"2024-09-11T01:12:47.595649+0000","last_active":"2024-09-11T01:12:47.595649+0000","last_peered":"2024-09-11T01:12:47.595649+0000","last_clean":"2024-09-11T01:12:47.595649+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:47.595649+0000","last_undegraded":"2024-09-11T01:12:47.595649+0000","last_fullsized":"2024-09-11T01:12:47.595649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:47.595583+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:47.595583+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.595583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:29.975829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:30.279045+0000","last_change":"2024-09-11T00:44:21.384965+0000","last_active":"2024-09-11T01:12:30.279045+0000","last_peered":"2024-09-11T01:12:30.279045+0000","last_clean":"2024-09-11T01:12:30.279045+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:12:30.279045+0000","last_undegraded":"2024-09-11T01:12:30.279045+0000","last_fullsized":"2024-09-11T01:12:30.279045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:44:20.341177+0000","last_clean_scrub_stamp":"2024-09-11T00:44:20.341177+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:02.674279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.930312+0000","last_change":"2024-09-11T01:12:50.930312+0000","last_active":"2024-09-11T01:12:50.930312+0000","last_peered":"2024-09-11T01:12:50.930312+0000","last_clean":"2024-09-11T01:12:50.930312+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:50.930312+0000","last_undegraded":"2024-09-11T01:12:50.930312+0000","last_fullsized":"2024-09-11T01:12:50.930312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:50.930241+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:50.930241+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.930241+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:34.201227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.198400+0000","last_change":"2024-09-11T01:12:48.198400+0000","last_active":"2024-09-11T01:12:48.198400+0000","last_peered":"2024-09-11T01:12:48.198400+0000","last_clean":"2024-09-11T01:12:48.198400+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:12:48.198400+0000","last_undegraded":"2024-09-11T01:12:48.198400+0000","last_fullsized":"2024-09-11T01:12:48.198400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:48.198324+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:48.198324+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.198324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:24.744720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.582077+0000","last_change":"2024-09-11T01:12:49.582077+0000","last_active":"2024-09-11T01:12:49.582077+0000","last_peered":"2024-09-11T01:12:49.582077+0000","last_clean":"2024-09-11T01:12:49.582077+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:49.582077+0000","last_undegraded":"2024-09-11T01:12:49.582077+0000","last_fullsized":"2024-09-11T01:12:49.582077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-11T01:12:49.581998+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-11T01:12:49.581998+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.581998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:43.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.355545+0000","last_change":"2024-09-11T01:12:54.355545+0000","last_active":"2024-09-11T01:12:54.355545+0000","last_peered":"2024-09-11T01:12:54.355545+0000","last_clean":"2024-09-11T01:12:54.355545+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:54.355545+0000","last_undegraded":"2024-09-11T01:12:54.355545+0000","last_fullsized":"2024-09-11T01:12:54.355545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:54.355472+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:54.355472+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.355472+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:38.543149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3068,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.329159+0000","last_change":"2024-09-11T01:12:59.329159+0000","last_active":"2024-09-11T01:12:59.329159+0000","last_peered":"2024-09-11T01:12:59.329159+0000","last_clean":"2024-09-11T01:12:59.329159+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:59.329159+0000","last_undegraded":"2024-09-11T01:12:59.329159+0000","last_fullsized":"2024-09-11T01:12:59.329159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3030","last_scrub_stamp":"2024-09-11T01:12:59.329043+0000","last_deep_scrub":"29'3030","last_deep_scrub_stamp":"2024-09-11T01:12:59.329043+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.329043+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:48.409796+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'609","reported_seq":655,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.897182+0000","last_change":"2024-09-11T01:12:46.897182+0000","last_active":"2024-09-11T01:12:46.897182+0000","last_peered":"2024-09-11T01:12:46.897182+0000","last_clean":"2024-09-11T01:12:46.897182+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:12:46.897182+0000","last_undegraded":"2024-09-11T01:12:46.897182+0000","last_fullsized":"2024-09-11T01:12:46.897182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'609","last_scrub_stamp":"2024-09-11T01:12:46.897060+0000","last_deep_scrub":"29'609","last_deep_scrub_stamp":"2024-09-11T01:12:46.897060+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.897060+0000","objects_scrubbed":1,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:10.906240+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.706544+0000","last_change":"2024-09-11T01:12:45.706544+0000","last_active":"2024-09-11T01:12:45.706544+0000","last_peered":"2024-09-11T01:12:45.706544+0000","last_clean":"2024-09-11T01:12:45.706544+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:45.706544+0000","last_undegraded":"2024-09-11T01:12:45.706544+0000","last_fullsized":"2024-09-11T01:12:45.706544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:45.706481+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:45.706481+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.706481+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.291495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.406904+0000","last_change":"2024-09-11T01:12:54.406904+0000","last_active":"2024-09-11T01:12:54.406904+0000","last_peered":"2024-09-11T01:12:54.406904+0000","last_clean":"2024-09-11T01:12:54.406904+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:54.406904+0000","last_undegraded":"2024-09-11T01:12:54.406904+0000","last_fullsized":"2024-09-11T01:12:54.406904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3873","last_scrub_stamp":"2024-09-11T01:12:54.406766+0000","last_deep_scrub":"29'3873","last_deep_scrub_stamp":"2024-09-11T01:12:54.406766+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.406766+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:18.705454+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.654823+0000","last_change":"2024-09-11T01:12:45.654823+0000","last_active":"2024-09-11T01:12:45.654823+0000","last_peered":"2024-09-11T01:12:45.654823+0000","last_clean":"2024-09-11T01:12:45.654823+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:45.654823+0000","last_undegraded":"2024-09-11T01:12:45.654823+0000","last_fullsized":"2024-09-11T01:12:45.654823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:45.654757+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:45.654757+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.654757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:25.061395+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.335958+0000","last_change":"2024-09-11T01:12:50.335958+0000","last_active":"2024-09-11T01:12:50.335958+0000","last_peered":"2024-09-11T01:12:50.335958+0000","last_clean":"2024-09-11T01:12:50.335958+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:50.335958+0000","last_undegraded":"2024-09-11T01:12:50.335958+0000","last_fullsized":"2024-09-11T01:12:50.335958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:50.335868+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:50.335868+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.335868+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.878109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.392950+0000","last_change":"2024-09-11T01:12:59.392950+0000","last_active":"2024-09-11T01:12:59.392950+0000","last_peered":"2024-09-11T01:12:59.392950+0000","last_clean":"2024-09-11T01:12:59.392950+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:59.392950+0000","last_undegraded":"2024-09-11T01:12:59.392950+0000","last_fullsized":"2024-09-11T01:12:59.392950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:59.392874+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:59.392874+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.392874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:36.890952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.950793+0000","last_change":"2024-09-11T01:12:54.950793+0000","last_active":"2024-09-11T01:12:54.950793+0000","last_peered":"2024-09-11T01:12:54.950793+0000","last_clean":"2024-09-11T01:12:54.950793+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:54.950793+0000","last_undegraded":"2024-09-11T01:12:54.950793+0000","last_fullsized":"2024-09-11T01:12:54.950793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:54.950714+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:54.950714+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.950714+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:12.687187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.152979+0000","last_change":"2024-09-11T01:12:54.152979+0000","last_active":"2024-09-11T01:12:54.152979+0000","last_peered":"2024-09-11T01:12:54.152979+0000","last_clean":"2024-09-11T01:12:54.152979+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:54.152979+0000","last_undegraded":"2024-09-11T01:12:54.152979+0000","last_fullsized":"2024-09-11T01:12:54.152979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:54.152901+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:54.152901+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.152901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:26.531531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.163818+0000","last_change":"2024-09-11T01:12:51.163818+0000","last_active":"2024-09-11T01:12:51.163818+0000","last_peered":"2024-09-11T01:12:51.163818+0000","last_clean":"2024-09-11T01:12:51.163818+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:51.163818+0000","last_undegraded":"2024-09-11T01:12:51.163818+0000","last_fullsized":"2024-09-11T01:12:51.163818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-09-11T01:12:51.163726+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-09-11T01:12:51.163726+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.163726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:07.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.834233+0000","last_change":"2024-09-11T01:12:56.834233+0000","last_active":"2024-09-11T01:12:56.834233+0000","last_peered":"2024-09-11T01:12:56.834233+0000","last_clean":"2024-09-11T01:12:56.834233+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:56.834233+0000","last_undegraded":"2024-09-11T01:12:56.834233+0000","last_fullsized":"2024-09-11T01:12:56.834233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:56.834136+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:56.834136+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.834136+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:35.485490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.913414+0000","last_change":"2024-09-11T01:12:53.913414+0000","last_active":"2024-09-11T01:12:53.913414+0000","last_peered":"2024-09-11T01:12:53.913414+0000","last_clean":"2024-09-11T01:12:53.913414+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:53.913414+0000","last_undegraded":"2024-09-11T01:12:53.913414+0000","last_fullsized":"2024-09-11T01:12:53.913414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:53.913304+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:53.913304+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.913304+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.941511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.398577+0000","last_change":"2024-09-11T01:13:00.398577+0000","last_active":"2024-09-11T01:13:00.398577+0000","last_peered":"2024-09-11T01:13:00.398577+0000","last_clean":"2024-09-11T01:13:00.398577+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:13:00.398577+0000","last_undegraded":"2024-09-11T01:13:00.398577+0000","last_fullsized":"2024-09-11T01:13:00.398577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:13:00.398501+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:13:00.398501+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.398501+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:30.625471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.963849+0000","last_change":"2024-09-11T01:12:55.963849+0000","last_active":"2024-09-11T01:12:55.963849+0000","last_peered":"2024-09-11T01:12:55.963849+0000","last_clean":"2024-09-11T01:12:55.963849+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:55.963849+0000","last_undegraded":"2024-09-11T01:12:55.963849+0000","last_fullsized":"2024-09-11T01:12:55.963849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:55.963765+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:55.963765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.963765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:27.888441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.663725+0000","last_change":"2024-09-11T01:12:48.663725+0000","last_active":"2024-09-11T01:12:48.663725+0000","last_peered":"2024-09-11T01:12:48.663725+0000","last_clean":"2024-09-11T01:12:48.663725+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:48.663725+0000","last_undegraded":"2024-09-11T01:12:48.663725+0000","last_fullsized":"2024-09-11T01:12:48.663725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:48.663642+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:48.663642+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.663642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:14.306206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.329472+0000","last_change":"2024-09-11T01:12:55.329472+0000","last_active":"2024-09-11T01:12:55.329472+0000","last_peered":"2024-09-11T01:12:55.329472+0000","last_clean":"2024-09-11T01:12:55.329472+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:55.329472+0000","last_undegraded":"2024-09-11T01:12:55.329472+0000","last_fullsized":"2024-09-11T01:12:55.329472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-11T01:12:55.329366+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-11T01:12:55.329366+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.329366+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:58.634535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.170096+0000","last_change":"2024-09-11T01:12:52.170096+0000","last_active":"2024-09-11T01:12:52.170096+0000","last_peered":"2024-09-11T01:12:52.170096+0000","last_clean":"2024-09-11T01:12:52.170096+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:52.170096+0000","last_undegraded":"2024-09-11T01:12:52.170096+0000","last_fullsized":"2024-09-11T01:12:52.170096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:52.170011+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:52.170011+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.170011+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:24.958076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:01.446902+0000","last_change":"2024-09-11T01:13:01.446902+0000","last_active":"2024-09-11T01:13:01.446902+0000","last_peered":"2024-09-11T01:13:01.446902+0000","last_clean":"2024-09-11T01:13:01.446902+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:13:01.446902+0000","last_undegraded":"2024-09-11T01:13:01.446902+0000","last_fullsized":"2024-09-11T01:13:01.446902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-11T01:13:01.446785+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-11T01:13:01.446785+0000","last_clean_scrub_stamp":"2024-09-11T01:13:01.446785+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:51.791215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.315601+0000","last_change":"2024-09-11T01:12:49.315601+0000","last_active":"2024-09-11T01:12:49.315601+0000","last_peered":"2024-09-11T01:12:49.315601+0000","last_clean":"2024-09-11T01:12:49.315601+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:49.315601+0000","last_undegraded":"2024-09-11T01:12:49.315601+0000","last_fullsized":"2024-09-11T01:12:49.315601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:49.315529+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:49.315529+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.315529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:39.514037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:03.403505+0000","last_change":"2024-09-11T01:13:03.403505+0000","last_active":"2024-09-11T01:13:03.403505+0000","last_peered":"2024-09-11T01:13:03.403505+0000","last_clean":"2024-09-11T01:13:03.403505+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:13:03.403505+0000","last_undegraded":"2024-09-11T01:13:03.403505+0000","last_fullsized":"2024-09-11T01:13:03.403505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:13:03.403415+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:13:03.403415+0000","last_clean_scrub_stamp":"2024-09-11T01:13:03.403415+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:39.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:02.409901+0000","last_change":"2024-09-11T01:13:02.409901+0000","last_active":"2024-09-11T01:13:02.409901+0000","last_peered":"2024-09-11T01:13:02.409901+0000","last_clean":"2024-09-11T01:13:02.409901+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:13:02.409901+0000","last_undegraded":"2024-09-11T01:13:02.409901+0000","last_fullsized":"2024-09-11T01:13:02.409901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:13:02.409821+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:13:02.409821+0000","last_clean_scrub_stamp":"2024-09-11T01:13:02.409821+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:53.338067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.004394+0000","last_change":"2024-09-11T01:12:57.004394+0000","last_active":"2024-09-11T01:12:57.004394+0000","last_peered":"2024-09-11T01:12:57.004394+0000","last_clean":"2024-09-11T01:12:57.004394+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:57.004394+0000","last_undegraded":"2024-09-11T01:12:57.004394+0000","last_fullsized":"2024-09-11T01:12:57.004394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:57.004279+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:57.004279+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.004279+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:54.283518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.187195+0000","last_change":"2024-09-11T01:12:52.187195+0000","last_active":"2024-09-11T01:12:52.187195+0000","last_peered":"2024-09-11T01:12:52.187195+0000","last_clean":"2024-09-11T01:12:52.187195+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:52.187195+0000","last_undegraded":"2024-09-11T01:12:52.187195+0000","last_fullsized":"2024-09-11T01:12:52.187195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:52.187116+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:52.187116+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.187116+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.964382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.106690+0000","last_change":"2024-09-11T01:12:55.106690+0000","last_active":"2024-09-11T01:12:55.106690+0000","last_peered":"2024-09-11T01:12:55.106690+0000","last_clean":"2024-09-11T01:12:55.106690+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:55.106690+0000","last_undegraded":"2024-09-11T01:12:55.106690+0000","last_fullsized":"2024-09-11T01:12:55.106690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:55.106568+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:55.106568+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.106568+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:50.249736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.150506+0000","last_change":"2024-09-11T01:12:54.150506+0000","last_active":"2024-09-11T01:12:54.150506+0000","last_peered":"2024-09-11T01:12:54.150506+0000","last_clean":"2024-09-11T01:12:54.150506+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:54.150506+0000","last_undegraded":"2024-09-11T01:12:54.150506+0000","last_fullsized":"2024-09-11T01:12:54.150506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:54.150422+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:54.150422+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.150422+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:37.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.179475+0000","last_change":"2024-09-11T01:12:53.179475+0000","last_active":"2024-09-11T01:12:53.179475+0000","last_peered":"2024-09-11T01:12:53.179475+0000","last_clean":"2024-09-11T01:12:53.179475+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:53.179475+0000","last_undegraded":"2024-09-11T01:12:53.179475+0000","last_fullsized":"2024-09-11T01:12:53.179475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:53.179379+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:53.179379+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.179379+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:31.830733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.110016+0000","last_change":"2024-09-11T01:12:55.110016+0000","last_active":"2024-09-11T01:12:55.110016+0000","last_peered":"2024-09-11T01:12:55.110016+0000","last_clean":"2024-09-11T01:12:55.110016+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:55.110016+0000","last_undegraded":"2024-09-11T01:12:55.110016+0000","last_fullsized":"2024-09-11T01:12:55.110016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:55.109941+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:55.109941+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.109941+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:25.703308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.669985+0000","last_change":"2024-09-11T01:12:46.669985+0000","last_active":"2024-09-11T01:12:46.669985+0000","last_peered":"2024-09-11T01:12:46.669985+0000","last_clean":"2024-09-11T01:12:46.669985+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:46.669985+0000","last_undegraded":"2024-09-11T01:12:46.669985+0000","last_fullsized":"2024-09-11T01:12:46.669985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:46.669891+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:46.669891+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.669891+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:41.909794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.017586+0000","last_change":"2024-09-11T01:12:58.017586+0000","last_active":"2024-09-11T01:12:58.017586+0000","last_peered":"2024-09-11T01:12:58.017586+0000","last_clean":"2024-09-11T01:12:58.017586+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:58.017586+0000","last_undegraded":"2024-09-11T01:12:58.017586+0000","last_fullsized":"2024-09-11T01:12:58.017586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:58.017484+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:58.017484+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.017484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:40.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.381877+0000","last_change":"2024-09-11T01:12:53.381877+0000","last_active":"2024-09-11T01:12:53.381877+0000","last_peered":"2024-09-11T01:12:53.381877+0000","last_clean":"2024-09-11T01:12:53.381877+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:53.381877+0000","last_undegraded":"2024-09-11T01:12:53.381877+0000","last_fullsized":"2024-09-11T01:12:53.381877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:53.381780+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:53.381780+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.381780+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:19.257767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.728355+0000","last_change":"2024-09-11T01:12:47.728355+0000","last_active":"2024-09-11T01:12:47.728355+0000","last_peered":"2024-09-11T01:12:47.728355+0000","last_clean":"2024-09-11T01:12:47.728355+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:47.728355+0000","last_undegraded":"2024-09-11T01:12:47.728355+0000","last_fullsized":"2024-09-11T01:12:47.728355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:47.728294+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:47.728294+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.728294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:07.968503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.154564+0000","last_change":"2024-09-11T01:12:56.154564+0000","last_active":"2024-09-11T01:12:56.154564+0000","last_peered":"2024-09-11T01:12:56.154564+0000","last_clean":"2024-09-11T01:12:56.154564+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:56.154564+0000","last_undegraded":"2024-09-11T01:12:56.154564+0000","last_fullsized":"2024-09-11T01:12:56.154564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:56.154485+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:56.154485+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.154485+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:10.154796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.679483+0000","last_change":"2024-09-11T01:12:46.679483+0000","last_active":"2024-09-11T01:12:46.679483+0000","last_peered":"2024-09-11T01:12:46.679483+0000","last_clean":"2024-09-11T01:12:46.679483+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:46.679483+0000","last_undegraded":"2024-09-11T01:12:46.679483+0000","last_fullsized":"2024-09-11T01:12:46.679483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-09-11T01:12:46.679424+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-09-11T01:12:46.679424+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.679424+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:03.216320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.013345+0000","last_change":"2024-09-11T01:12:59.013345+0000","last_active":"2024-09-11T01:12:59.013345+0000","last_peered":"2024-09-11T01:12:59.013345+0000","last_clean":"2024-09-11T01:12:59.013345+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:59.013345+0000","last_undegraded":"2024-09-11T01:12:59.013345+0000","last_fullsized":"2024-09-11T01:12:59.013345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:59.013265+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:59.013265+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.013265+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:50.078901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.980037+0000","last_change":"2024-09-11T01:12:59.980037+0000","last_active":"2024-09-11T01:12:59.980037+0000","last_peered":"2024-09-11T01:12:59.980037+0000","last_clean":"2024-09-11T01:12:59.980037+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:59.980037+0000","last_undegraded":"2024-09-11T01:12:59.980037+0000","last_fullsized":"2024-09-11T01:12:59.980037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-11T01:12:59.979925+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-11T01:12:59.979925+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.979925+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:05.881456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.174352+0000","last_change":"2024-09-11T01:12:57.174352+0000","last_active":"2024-09-11T01:12:57.174352+0000","last_peered":"2024-09-11T01:12:57.174352+0000","last_clean":"2024-09-11T01:12:57.174352+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:57.174352+0000","last_undegraded":"2024-09-11T01:12:57.174352+0000","last_fullsized":"2024-09-11T01:12:57.174352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:57.174277+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:57.174277+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.174277+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:31.414776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15868047,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3778,"num_write_kb":16856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31736094,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3318,"ondisk_log_size":3318,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509790,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509790,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509789,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7508501,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509790,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":578392,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":572414,"kb_avail":93793448,"statfs":{"total":96636764160,"available":96044490752,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":586152389},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509789,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509790,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575199,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7509263,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7384282,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7385044,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:13:06.816 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.816 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.817 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.817 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.817 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.818 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-11T00:44:20.341177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=44, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=12, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T01:13:06.819 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T01:13:16.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:13:16.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:13:26.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 -- 172.21.15.81:0/3570665237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44900052e0 msgr2=0x7f449000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 --2- 172.21.15.81:0/3570665237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44900052e0 0x7f449000b9c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f44ac1560c0 tx=0x7f4490005830 comp rx=0 tx=0).stop 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 -- 172.21.15.81:0/3570665237 shutdown_connections 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 --2- 172.21.15.81:0/3570665237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44900052e0 0x7f449000b9c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 -- 172.21.15.81:0/3570665237 >> 172.21.15.81:0/3570665237 conn(0x7f44ac0700f0 msgr2=0x7f44ac070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 -- 172.21.15.81:0/3570665237 shutdown_connections 2024-09-11T01:13:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.987+0000 7f44b1000640 1 -- 172.21.15.81:0/3570665237 wait complete. 2024-09-11T01:13:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.988+0000 7f44b1000640 1 Processor -- start 2024-09-11T01:13:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 -- start start 2024-09-11T01:13:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900052e0 0x7f44ac0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44ac1e1ba0 0x7f44ac1f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac070cf0 con 0x7f44ac0cb750 2024-09-11T01:13:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac15c140 con 0x7f44900052e0 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.989+0000 7f44b1000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f44ac1529f0 con 0x7f44ac1e1ba0 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46380/0 (socket says 172.21.15.81:46380) 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 -- 172.21.15.81:0/3255333276 learned_addr learned my addr 172.21.15.81:0/3255333276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44a9e00640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900052e0 0x7f44ac0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44a9400640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44ac1e1ba0 0x7f44ac1f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 -- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44ac1e1ba0 msgr2=0x7f44ac1f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44ac1e1ba0 0x7f44ac1f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 -- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900052e0 msgr2=0x7f44ac0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900052e0 0x7f44ac0ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 -- 172.21.15.81:0/3255333276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac1e1fa0 con 0x7f44ac0cb750 2024-09-11T01:13:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.990+0000 7f44aa800640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f44a402aa90 tx=0x7f44a40092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.991+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4009b00 con 0x7f44ac0cb750 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.991+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44a4041070 con 0x7f44ac0cb750 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.991+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac14c0b0 con 0x7f44ac0cb750 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.991+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a40055d0 con 0x7f44ac0cb750 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.991+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac1e3550 con 0x7f44ac0cb750 2024-09-11T01:13:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.992+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ac0c2ea0 con 0x7f44ac0cb750 2024-09-11T01:13:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.993+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f44a400f040 con 0x7f44ac0cb750 2024-09-11T01:13:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.994+0000 7f44a2000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 0x7f448c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.994+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f44a40baa70 con 0x7f44ac0cb750 2024-09-11T01:13:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.994+0000 7f44a9e00640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 0x7f448c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.995+0000 7f44a9e00640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 0x7f448c07a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44ac074fb0 tx=0x7f449c0067a0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:26.998+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f44a4083170 con 0x7f44ac0cb750 2024-09-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.177+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 --> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44ac0c2a70 con 0x7f448c077f70 2024-09-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.184+0000 7f44a2000640 1 -- 172.21.15.81:0/3255333276 <== mgr.4124 v2:172.21.15.167:6800/1151185883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334648 (secure 0 0 0) 0x7f44ac0c2a70 con 0x7f448c077f70 2024-09-11T01:13:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:13:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 msgr2=0x7f448c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 0x7f448c07a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44ac074fb0 tx=0x7f449c0067a0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 msgr2=0x7f44ac14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f44a402aa90 tx=0x7f44a40092c0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 shutdown_connections 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f448c077f70 0x7f448c07a430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44ac0cb750 0x7f44ac14b580 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44ac1e1ba0 0x7f44ac1f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 --2- 172.21.15.81:0/3255333276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44900052e0 0x7f44ac0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 >> 172.21.15.81:0/3255333276 conn(0x7f44ac0700f0 msgr2=0x7f44ac06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 shutdown_connections 2024-09-11T01:13:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.188+0000 7f44b1000640 1 -- 172.21.15.81:0/3255333276 wait complete. 2024-09-11T01:13:27.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":904,"stamp":"2024-09-11T01:13:26.351343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16458415,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":122,"num_read_kb":187,"num_write":617528,"num_write_kb":15568566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122335,"ondisk_log_size":122335,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5103872,"kb_used_data":23040,"kb_used_omap":12,"kb_used_meta":5080691,"kb_avail":749870848,"statfs":{"total":773094113280,"available":767867748352,"internally_reserved":0,"allocated":23592960,"data_stored":33910582,"data_compressed":2497322,"data_compressed_allocated":3473408,"data_compressed_original":15327232,"omap_allocated":12751,"internal_metadata":5202628145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003708"},"pg_stats":[{"pgid":"2.1f","version":"29'458","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.409310+0000","last_change":"2024-09-11T01:12:48.409256+0000","last_active":"2024-09-11T01:12:48.409310+0000","last_peered":"2024-09-11T01:12:48.409310+0000","last_clean":"2024-09-11T01:12:48.409310+0000","last_became_active":"2024-09-11T00:44:16.361889+0000","last_became_peered":"2024-09-11T00:44:16.361889+0000","last_unstale":"2024-09-11T01:12:48.409310+0000","last_undegraded":"2024-09-11T01:12:48.409310+0000","last_fullsized":"2024-09-11T01:12:48.409310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'458","last_scrub_stamp":"2024-09-11T01:12:48.409184+0000","last_deep_scrub":"29'458","last_deep_scrub_stamp":"2024-09-11T01:12:48.409184+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.409184+0000","objects_scrubbed":3,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:35:53.603534+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3189978,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.915525+0000","last_change":"2024-09-11T01:12:51.915525+0000","last_active":"2024-09-11T01:12:51.915525+0000","last_peered":"2024-09-11T01:12:51.915525+0000","last_clean":"2024-09-11T01:12:51.915525+0000","last_became_active":"2024-09-11T00:44:17.343681+0000","last_became_peered":"2024-09-11T00:44:17.343681+0000","last_unstale":"2024-09-11T01:12:51.915525+0000","last_undegraded":"2024-09-11T01:12:51.915525+0000","last_fullsized":"2024-09-11T01:12:51.915525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-11T01:12:51.915453+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-11T01:12:51.915453+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.915453+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:22.508820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4004","reported_seq":4043,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.413748+0000","last_change":"2024-09-11T01:12:56.413661+0000","last_active":"2024-09-11T01:12:56.413748+0000","last_peered":"2024-09-11T01:12:56.413748+0000","last_clean":"2024-09-11T01:12:56.413748+0000","last_became_active":"2024-09-11T00:44:21.381718+0000","last_became_peered":"2024-09-11T00:44:21.381718+0000","last_unstale":"2024-09-11T01:12:56.413748+0000","last_undegraded":"2024-09-11T01:12:56.413748+0000","last_fullsized":"2024-09-11T01:12:56.413748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4004","last_scrub_stamp":"2024-09-11T01:12:56.413536+0000","last_deep_scrub":"29'4004","last_deep_scrub_stamp":"2024-09-11T01:12:56.413536+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.413536+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:35.820174+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20838,"num_write_kb":517249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.849596+0000","last_change":"2024-09-11T01:12:45.849596+0000","last_active":"2024-09-11T01:12:45.849596+0000","last_peered":"2024-09-11T01:12:45.849596+0000","last_clean":"2024-09-11T01:12:45.849596+0000","last_became_active":"2024-09-11T00:44:16.339656+0000","last_became_peered":"2024-09-11T00:44:16.339656+0000","last_unstale":"2024-09-11T01:12:45.849596+0000","last_undegraded":"2024-09-11T01:12:45.849596+0000","last_fullsized":"2024-09-11T01:12:45.849596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-09-11T01:12:45.849505+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-09-11T01:12:45.849505+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.849505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:19.566999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'21","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.955818+0000","last_change":"2024-09-11T01:12:52.955818+0000","last_active":"2024-09-11T01:12:52.955818+0000","last_peered":"2024-09-11T01:12:52.955818+0000","last_clean":"2024-09-11T01:12:52.955818+0000","last_became_active":"2024-09-11T00:44:17.345252+0000","last_became_peered":"2024-09-11T00:44:17.345252+0000","last_unstale":"2024-09-11T01:12:52.955818+0000","last_undegraded":"2024-09-11T01:12:52.955818+0000","last_fullsized":"2024-09-11T01:12:52.955818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:52.955744+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:52.955744+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.955744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:06.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'3899","reported_seq":3938,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.764796+0000","last_change":"2024-09-11T01:12:51.764695+0000","last_active":"2024-09-11T01:12:51.764796+0000","last_peered":"2024-09-11T01:12:51.764796+0000","last_clean":"2024-09-11T01:12:51.764796+0000","last_became_active":"2024-09-11T00:44:21.383138+0000","last_became_peered":"2024-09-11T00:44:21.383138+0000","last_unstale":"2024-09-11T01:12:51.764796+0000","last_undegraded":"2024-09-11T01:12:51.764796+0000","last_fullsized":"2024-09-11T01:12:51.764796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3899","last_scrub_stamp":"2024-09-11T01:12:51.764590+0000","last_deep_scrub":"29'3899","last_deep_scrub_stamp":"2024-09-11T01:12:51.764590+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.764590+0000","objects_scrubbed":0,"log_size":3899,"log_dups_size":0,"ondisk_log_size":3899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:35.281753+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20105,"num_write_kb":501941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.164807+0000","last_change":"2024-09-11T01:12:46.164807+0000","last_active":"2024-09-11T01:12:46.164807+0000","last_peered":"2024-09-11T01:12:46.164807+0000","last_clean":"2024-09-11T01:12:46.164807+0000","last_became_active":"2024-09-11T00:44:16.359997+0000","last_became_peered":"2024-09-11T00:44:16.359997+0000","last_unstale":"2024-09-11T01:12:46.164807+0000","last_undegraded":"2024-09-11T01:12:46.164807+0000","last_fullsized":"2024-09-11T01:12:46.164807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:46.164750+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:46.164750+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.164750+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:15.665354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'17","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.672254+0000","last_change":"2024-09-11T01:12:49.672254+0000","last_active":"2024-09-11T01:12:49.672254+0000","last_peered":"2024-09-11T01:12:49.672254+0000","last_clean":"2024-09-11T01:12:49.672254+0000","last_became_active":"2024-09-11T00:44:17.348910+0000","last_became_peered":"2024-09-11T00:44:17.348910+0000","last_unstale":"2024-09-11T01:12:49.672254+0000","last_undegraded":"2024-09-11T01:12:49.672254+0000","last_fullsized":"2024-09-11T01:12:49.672254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:49.672142+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:49.672142+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.672142+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:38.502372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3785","reported_seq":3823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.749970+0000","last_change":"2024-09-11T01:12:53.749970+0000","last_active":"2024-09-11T01:12:53.749970+0000","last_peered":"2024-09-11T01:12:53.749970+0000","last_clean":"2024-09-11T01:12:53.749970+0000","last_became_active":"2024-09-11T00:44:21.385971+0000","last_became_peered":"2024-09-11T00:44:21.385971+0000","last_unstale":"2024-09-11T01:12:53.749970+0000","last_undegraded":"2024-09-11T01:12:53.749970+0000","last_fullsized":"2024-09-11T01:12:53.749970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3785","last_scrub_stamp":"2024-09-11T01:12:53.749863+0000","last_deep_scrub":"29'3785","last_deep_scrub_stamp":"2024-09-11T01:12:53.749863+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.749863+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:10.033800+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19148,"num_write_kb":477586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.162654+0000","last_change":"2024-09-11T01:12:45.162654+0000","last_active":"2024-09-11T01:12:45.162654+0000","last_peered":"2024-09-11T01:12:45.162654+0000","last_clean":"2024-09-11T01:12:45.162654+0000","last_became_active":"2024-09-11T00:44:16.360013+0000","last_became_peered":"2024-09-11T00:44:16.360013+0000","last_unstale":"2024-09-11T01:12:45.162654+0000","last_undegraded":"2024-09-11T01:12:45.162654+0000","last_fullsized":"2024-09-11T01:12:45.162654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:45.162594+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:45.162594+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.162594+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:35.822703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'27","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.434750+0000","last_change":"2024-09-11T01:12:58.434750+0000","last_active":"2024-09-11T01:12:58.434750+0000","last_peered":"2024-09-11T01:12:58.434750+0000","last_clean":"2024-09-11T01:12:58.434750+0000","last_became_active":"2024-09-11T00:44:17.363782+0000","last_became_peered":"2024-09-11T00:44:17.363782+0000","last_unstale":"2024-09-11T01:12:58.434750+0000","last_undegraded":"2024-09-11T01:12:58.434750+0000","last_fullsized":"2024-09-11T01:12:58.434750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:58.434645+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:58.434645+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.434645+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.653485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3167","reported_seq":3205,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.775936+0000","last_change":"2024-09-11T01:12:52.775936+0000","last_active":"2024-09-11T01:12:52.775936+0000","last_peered":"2024-09-11T01:12:52.775936+0000","last_clean":"2024-09-11T01:12:52.775936+0000","last_became_active":"2024-09-11T00:44:21.386233+0000","last_became_peered":"2024-09-11T00:44:21.386233+0000","last_unstale":"2024-09-11T01:12:52.775936+0000","last_undegraded":"2024-09-11T01:12:52.775936+0000","last_fullsized":"2024-09-11T01:12:52.775936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3167","last_scrub_stamp":"2024-09-11T01:12:52.775844+0000","last_deep_scrub":"29'3167","last_deep_scrub_stamp":"2024-09-11T01:12:52.775844+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.775844+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:48.548603+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16254,"num_write_kb":416887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.506197+0000","last_change":"2024-09-11T01:12:53.506197+0000","last_active":"2024-09-11T01:12:53.506197+0000","last_peered":"2024-09-11T01:12:53.506197+0000","last_clean":"2024-09-11T01:12:53.506197+0000","last_became_active":"2024-09-11T00:44:17.350849+0000","last_became_peered":"2024-09-11T00:44:17.350849+0000","last_unstale":"2024-09-11T01:12:53.506197+0000","last_undegraded":"2024-09-11T01:12:53.506197+0000","last_fullsized":"2024-09-11T01:12:53.506197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:53.506087+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:53.506087+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.506087+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:24.175112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'1196","reported_seq":1243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.605365+0000","last_change":"2024-09-11T01:12:46.605365+0000","last_active":"2024-09-11T01:12:46.605365+0000","last_peered":"2024-09-11T01:12:46.605365+0000","last_clean":"2024-09-11T01:12:46.605365+0000","last_became_active":"2024-09-11T00:44:16.356067+0000","last_became_peered":"2024-09-11T00:44:16.356067+0000","last_unstale":"2024-09-11T01:12:46.605365+0000","last_undegraded":"2024-09-11T01:12:46.605365+0000","last_fullsized":"2024-09-11T01:12:46.605365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1196","last_scrub_stamp":"2024-09-11T01:12:46.605304+0000","last_deep_scrub":"29'1196","last_deep_scrub_stamp":"2024-09-11T01:12:46.605304+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.605304+0000","objects_scrubbed":2,"log_size":1196,"log_dups_size":0,"ondisk_log_size":1196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:43.884542+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":4383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'3168","reported_seq":3207,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:07.332724+0000","last_change":"2024-09-11T01:13:07.332724+0000","last_active":"2024-09-11T01:13:07.332724+0000","last_peered":"2024-09-11T01:13:07.332724+0000","last_clean":"2024-09-11T01:13:07.332724+0000","last_became_active":"2024-09-11T00:44:21.374714+0000","last_became_peered":"2024-09-11T00:44:21.374714+0000","last_unstale":"2024-09-11T01:13:07.332724+0000","last_undegraded":"2024-09-11T01:13:07.332724+0000","last_fullsized":"2024-09-11T01:13:07.332724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3168","last_scrub_stamp":"2024-09-11T01:13:07.332645+0000","last_deep_scrub":"29'3168","last_deep_scrub_stamp":"2024-09-11T01:13:07.332645+0000","last_clean_scrub_stamp":"2024-09-11T01:13:07.332645+0000","objects_scrubbed":0,"log_size":3168,"log_dups_size":0,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:20.070328+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16264,"num_write_kb":474203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'17","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.357645+0000","last_change":"2024-09-11T01:12:51.357645+0000","last_active":"2024-09-11T01:12:51.357645+0000","last_peered":"2024-09-11T01:12:51.357645+0000","last_clean":"2024-09-11T01:12:51.357645+0000","last_became_active":"2024-09-11T00:44:17.355495+0000","last_became_peered":"2024-09-11T00:44:17.355495+0000","last_unstale":"2024-09-11T01:12:51.357645+0000","last_undegraded":"2024-09-11T01:12:51.357645+0000","last_fullsized":"2024-09-11T01:12:51.357645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:51.357555+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:51.357555+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.357555+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:03.613151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.200554+0000","last_change":"2024-09-11T01:12:47.200554+0000","last_active":"2024-09-11T01:12:47.200554+0000","last_peered":"2024-09-11T01:12:47.200554+0000","last_clean":"2024-09-11T01:12:47.200554+0000","last_became_active":"2024-09-11T00:44:16.345189+0000","last_became_peered":"2024-09-11T00:44:16.345189+0000","last_unstale":"2024-09-11T01:12:47.200554+0000","last_undegraded":"2024-09-11T01:12:47.200554+0000","last_fullsized":"2024-09-11T01:12:47.200554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:47.200483+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:47.200483+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.200483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:11.499171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'3715","reported_seq":3754,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.222298+0000","last_change":"2024-09-11T01:12:58.222298+0000","last_active":"2024-09-11T01:12:58.222298+0000","last_peered":"2024-09-11T01:12:58.222298+0000","last_clean":"2024-09-11T01:12:58.222298+0000","last_became_active":"2024-09-11T00:44:21.381414+0000","last_became_peered":"2024-09-11T00:44:21.381414+0000","last_unstale":"2024-09-11T01:12:58.222298+0000","last_undegraded":"2024-09-11T01:12:58.222298+0000","last_fullsized":"2024-09-11T01:12:58.222298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3715","last_scrub_stamp":"2024-09-11T01:12:58.222191+0000","last_deep_scrub":"29'3715","last_deep_scrub_stamp":"2024-09-11T01:12:58.222191+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.222191+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:15.958664+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19634,"num_write_kb":491774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.402835+0000","last_change":"2024-09-11T01:12:50.402835+0000","last_active":"2024-09-11T01:12:50.402835+0000","last_peered":"2024-09-11T01:12:50.402835+0000","last_clean":"2024-09-11T01:12:50.402835+0000","last_became_active":"2024-09-11T00:44:17.343163+0000","last_became_peered":"2024-09-11T00:44:17.343163+0000","last_unstale":"2024-09-11T01:12:50.402835+0000","last_undegraded":"2024-09-11T01:12:50.402835+0000","last_fullsized":"2024-09-11T01:12:50.402835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:50.402765+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:50.402765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.402765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:26.759234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.397992+0000","last_change":"2024-09-11T01:12:46.397992+0000","last_active":"2024-09-11T01:12:46.397992+0000","last_peered":"2024-09-11T01:12:46.397992+0000","last_clean":"2024-09-11T01:12:46.397992+0000","last_became_active":"2024-09-11T00:44:16.373183+0000","last_became_peered":"2024-09-11T00:44:16.373183+0000","last_unstale":"2024-09-11T01:12:46.397992+0000","last_undegraded":"2024-09-11T01:12:46.397992+0000","last_fullsized":"2024-09-11T01:12:46.397992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:46.397924+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:46.397924+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.397924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:23.404988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4232","reported_seq":4271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.431439+0000","last_change":"2024-09-11T01:12:52.431439+0000","last_active":"2024-09-11T01:12:52.431439+0000","last_peered":"2024-09-11T01:12:52.431439+0000","last_clean":"2024-09-11T01:12:52.431439+0000","last_became_active":"2024-09-11T00:44:21.381000+0000","last_became_peered":"2024-09-11T00:44:21.381000+0000","last_unstale":"2024-09-11T01:12:52.431439+0000","last_undegraded":"2024-09-11T01:12:52.431439+0000","last_fullsized":"2024-09-11T01:12:52.431439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4232","last_scrub_stamp":"2024-09-11T01:12:52.431291+0000","last_deep_scrub":"29'4232","last_deep_scrub_stamp":"2024-09-11T01:12:52.431291+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.431291+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:42.070542+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21668,"num_write_kb":569607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.546905+0000","last_change":"2024-09-11T01:12:50.546905+0000","last_active":"2024-09-11T01:12:50.546905+0000","last_peered":"2024-09-11T01:12:50.546905+0000","last_clean":"2024-09-11T01:12:50.546905+0000","last_became_active":"2024-09-11T00:44:17.350150+0000","last_became_peered":"2024-09-11T00:44:17.350150+0000","last_unstale":"2024-09-11T01:12:50.546905+0000","last_undegraded":"2024-09-11T01:12:50.546905+0000","last_fullsized":"2024-09-11T01:12:50.546905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:50.546812+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:50.546812+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.546812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:00.404581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:42.118320+0000","last_change":"2024-09-11T01:12:42.118320+0000","last_active":"2024-09-11T01:12:42.118320+0000","last_peered":"2024-09-11T01:12:42.118320+0000","last_clean":"2024-09-11T01:12:42.118320+0000","last_became_active":"2024-09-11T00:44:16.358881+0000","last_became_peered":"2024-09-11T00:44:16.358881+0000","last_unstale":"2024-09-11T01:12:42.118320+0000","last_undegraded":"2024-09-11T01:12:42.118320+0000","last_fullsized":"2024-09-11T01:12:42.118320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:42.118251+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:42.118251+0000","last_clean_scrub_stamp":"2024-09-11T01:12:42.118251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:02.477107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'3380","reported_seq":3427,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.893932+0000","last_change":"2024-09-11T01:12:57.893932+0000","last_active":"2024-09-11T01:12:57.893932+0000","last_peered":"2024-09-11T01:12:57.893932+0000","last_clean":"2024-09-11T01:12:57.893932+0000","last_became_active":"2024-09-11T00:44:57.846502+0000","last_became_peered":"2024-09-11T00:44:57.846502+0000","last_unstale":"2024-09-11T01:12:57.893932+0000","last_undegraded":"2024-09-11T01:12:57.893932+0000","last_fullsized":"2024-09-11T01:12:57.893932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3380","last_scrub_stamp":"2024-09-11T01:12:57.893822+0000","last_deep_scrub":"29'3380","last_deep_scrub_stamp":"2024-09-11T01:12:57.893822+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.893822+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:41.164808+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16837,"num_write_kb":427457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'26","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.426673+0000","last_change":"2024-09-11T01:12:49.426673+0000","last_active":"2024-09-11T01:12:49.426673+0000","last_peered":"2024-09-11T01:12:49.426673+0000","last_clean":"2024-09-11T01:12:49.426673+0000","last_became_active":"2024-09-11T00:44:17.345825+0000","last_became_peered":"2024-09-11T00:44:17.345825+0000","last_unstale":"2024-09-11T01:12:49.426673+0000","last_undegraded":"2024-09-11T01:12:49.426673+0000","last_fullsized":"2024-09-11T01:12:49.426673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2024-09-11T01:12:49.426600+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2024-09-11T01:12:49.426600+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.426600+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:34.179182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.479136+0000","last_change":"2024-09-11T01:12:52.479136+0000","last_active":"2024-09-11T01:12:52.479136+0000","last_peered":"2024-09-11T01:12:52.479136+0000","last_clean":"2024-09-11T01:12:52.479136+0000","last_became_active":"2024-09-11T00:44:16.366076+0000","last_became_peered":"2024-09-11T00:44:16.366076+0000","last_unstale":"2024-09-11T01:12:52.479136+0000","last_undegraded":"2024-09-11T01:12:52.479136+0000","last_fullsized":"2024-09-11T01:12:52.479136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:52.479026+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:52.479026+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.479026+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:37:16.580592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'3552","reported_seq":3593,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.776220+0000","last_change":"2024-09-11T01:12:48.776139+0000","last_active":"2024-09-11T01:12:48.776220+0000","last_peered":"2024-09-11T01:12:48.776220+0000","last_clean":"2024-09-11T01:12:48.776220+0000","last_became_active":"2024-09-11T00:44:21.384006+0000","last_became_peered":"2024-09-11T00:44:21.384006+0000","last_unstale":"2024-09-11T01:12:48.776220+0000","last_undegraded":"2024-09-11T01:12:48.776220+0000","last_fullsized":"2024-09-11T01:12:48.776220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3552","last_scrub_stamp":"2024-09-11T01:12:48.776006+0000","last_deep_scrub":"29'3552","last_deep_scrub_stamp":"2024-09-11T01:12:48.776006+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.776006+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:39.436115+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18803,"num_write_kb":488486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.408746+0000","last_change":"2024-09-11T01:12:51.408746+0000","last_active":"2024-09-11T01:12:51.408746+0000","last_peered":"2024-09-11T01:12:51.408746+0000","last_clean":"2024-09-11T01:12:51.408746+0000","last_became_active":"2024-09-11T00:44:17.352437+0000","last_became_peered":"2024-09-11T00:44:17.352437+0000","last_unstale":"2024-09-11T01:12:51.408746+0000","last_undegraded":"2024-09-11T01:12:51.408746+0000","last_fullsized":"2024-09-11T01:12:51.408746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:51.408669+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:51.408669+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.408669+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:16.821389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'459","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.358389+0000","last_change":"2024-09-11T01:12:44.358389+0000","last_active":"2024-09-11T01:12:44.358389+0000","last_peered":"2024-09-11T01:12:44.358389+0000","last_clean":"2024-09-11T01:12:44.358389+0000","last_became_active":"2024-09-11T00:44:16.366746+0000","last_became_peered":"2024-09-11T00:44:16.366746+0000","last_unstale":"2024-09-11T01:12:44.358389+0000","last_undegraded":"2024-09-11T01:12:44.358389+0000","last_fullsized":"2024-09-11T01:12:44.358389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'459","last_scrub_stamp":"2024-09-11T01:12:44.358307+0000","last_deep_scrub":"29'459","last_deep_scrub_stamp":"2024-09-11T01:12:44.358307+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.358307+0000","objects_scrubbed":1,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:09.593482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4128","reported_seq":4169,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.381757+0000","last_change":"2024-09-11T01:12:56.381757+0000","last_active":"2024-09-11T01:12:56.381757+0000","last_peered":"2024-09-11T01:12:56.381757+0000","last_clean":"2024-09-11T01:12:56.381757+0000","last_became_active":"2024-09-11T00:44:21.364165+0000","last_became_peered":"2024-09-11T00:44:21.364165+0000","last_unstale":"2024-09-11T01:12:56.381757+0000","last_undegraded":"2024-09-11T01:12:56.381757+0000","last_fullsized":"2024-09-11T01:12:56.381757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4128","last_scrub_stamp":"2024-09-11T01:12:56.381662+0000","last_deep_scrub":"29'4128","last_deep_scrub_stamp":"2024-09-11T01:12:56.381662+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.381662+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:39.895389+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21960,"num_write_kb":533878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.183225+0000","last_change":"2024-09-11T01:12:53.183225+0000","last_active":"2024-09-11T01:12:53.183225+0000","last_peered":"2024-09-11T01:12:53.183225+0000","last_clean":"2024-09-11T01:12:53.183225+0000","last_became_active":"2024-09-11T00:44:17.354472+0000","last_became_peered":"2024-09-11T00:44:17.354472+0000","last_unstale":"2024-09-11T01:12:53.183225+0000","last_undegraded":"2024-09-11T01:12:53.183225+0000","last_fullsized":"2024-09-11T01:12:53.183225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:53.183143+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:53.183143+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.183143+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.200291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.505490+0000","last_change":"2024-09-11T01:12:51.505490+0000","last_active":"2024-09-11T01:12:51.505490+0000","last_peered":"2024-09-11T01:12:51.505490+0000","last_clean":"2024-09-11T01:12:51.505490+0000","last_became_active":"2024-09-11T00:44:16.357125+0000","last_became_peered":"2024-09-11T00:44:16.357125+0000","last_unstale":"2024-09-11T01:12:51.505490+0000","last_undegraded":"2024-09-11T01:12:51.505490+0000","last_fullsized":"2024-09-11T01:12:51.505490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-09-11T01:12:51.505393+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-09-11T01:12:51.505393+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.505393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:42.324230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'3646","reported_seq":3686,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.116906+0000","last_change":"2024-09-11T01:12:57.116906+0000","last_active":"2024-09-11T01:12:57.116906+0000","last_peered":"2024-09-11T01:12:57.116906+0000","last_clean":"2024-09-11T01:12:57.116906+0000","last_became_active":"2024-09-11T00:44:21.369969+0000","last_became_peered":"2024-09-11T00:44:21.369969+0000","last_unstale":"2024-09-11T01:12:57.116906+0000","last_undegraded":"2024-09-11T01:12:57.116906+0000","last_fullsized":"2024-09-11T01:12:57.116906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3646","last_scrub_stamp":"2024-09-11T01:12:57.116774+0000","last_deep_scrub":"29'3646","last_deep_scrub_stamp":"2024-09-11T01:12:57.116774+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.116774+0000","objects_scrubbed":0,"log_size":3646,"log_dups_size":0,"ondisk_log_size":3646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:52.889533+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":446676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.628793+0000","last_change":"2024-09-11T01:12:44.628793+0000","last_active":"2024-09-11T01:12:44.628793+0000","last_peered":"2024-09-11T01:12:44.628793+0000","last_clean":"2024-09-11T01:12:44.628793+0000","last_became_active":"2024-09-11T00:44:17.348718+0000","last_became_peered":"2024-09-11T00:44:17.348718+0000","last_unstale":"2024-09-11T01:12:44.628793+0000","last_undegraded":"2024-09-11T01:12:44.628793+0000","last_fullsized":"2024-09-11T01:12:44.628793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:44.628736+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:44.628736+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.628736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:49.248388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'5","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.837310+0000","last_change":"2024-09-11T01:12:44.837310+0000","last_active":"2024-09-11T01:12:44.837310+0000","last_peered":"2024-09-11T01:12:44.837310+0000","last_clean":"2024-09-11T01:12:44.837310+0000","last_became_active":"2024-09-11T00:44:16.345097+0000","last_became_peered":"2024-09-11T00:44:16.345097+0000","last_unstale":"2024-09-11T01:12:44.837310+0000","last_undegraded":"2024-09-11T01:12:44.837310+0000","last_fullsized":"2024-09-11T01:12:44.837310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:44.837235+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:44.837235+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.837235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:28.354398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'3996","reported_seq":4036,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.099187+0000","last_change":"2024-09-11T01:12:56.099187+0000","last_active":"2024-09-11T01:12:56.099187+0000","last_peered":"2024-09-11T01:12:56.099187+0000","last_clean":"2024-09-11T01:12:56.099187+0000","last_became_active":"2024-09-11T00:44:21.374832+0000","last_became_peered":"2024-09-11T00:44:21.374832+0000","last_unstale":"2024-09-11T01:12:56.099187+0000","last_undegraded":"2024-09-11T01:12:56.099187+0000","last_fullsized":"2024-09-11T01:12:56.099187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3996","last_scrub_stamp":"2024-09-11T01:12:56.099086+0000","last_deep_scrub":"29'3996","last_deep_scrub_stamp":"2024-09-11T01:12:56.099086+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.099086+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:39.616249+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20812,"num_write_kb":541538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'17","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.202590+0000","last_change":"2024-09-11T01:12:47.202590+0000","last_active":"2024-09-11T01:12:47.202590+0000","last_peered":"2024-09-11T01:12:47.202590+0000","last_clean":"2024-09-11T01:12:47.202590+0000","last_became_active":"2024-09-11T00:44:17.362983+0000","last_became_peered":"2024-09-11T00:44:17.362983+0000","last_unstale":"2024-09-11T01:12:47.202590+0000","last_undegraded":"2024-09-11T01:12:47.202590+0000","last_fullsized":"2024-09-11T01:12:47.202590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:47.202527+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:47.202527+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.202527+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:42.345696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.610635+0000","last_change":"2024-09-11T01:12:45.610548+0000","last_active":"2024-09-11T01:12:45.610635+0000","last_peered":"2024-09-11T01:12:45.610635+0000","last_clean":"2024-09-11T01:12:45.610635+0000","last_became_active":"2024-09-11T00:44:16.353588+0000","last_became_peered":"2024-09-11T00:44:16.353588+0000","last_unstale":"2024-09-11T01:12:45.610635+0000","last_undegraded":"2024-09-11T01:12:45.610635+0000","last_fullsized":"2024-09-11T01:12:45.610635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:45.610472+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:45.610472+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.610472+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:17.535148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'3638","reported_seq":3678,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.129127+0000","last_change":"2024-09-11T01:12:58.129127+0000","last_active":"2024-09-11T01:12:58.129127+0000","last_peered":"2024-09-11T01:12:58.129127+0000","last_clean":"2024-09-11T01:12:58.129127+0000","last_became_active":"2024-09-11T00:44:21.374274+0000","last_became_peered":"2024-09-11T00:44:21.374274+0000","last_unstale":"2024-09-11T01:12:58.129127+0000","last_undegraded":"2024-09-11T01:12:58.129127+0000","last_fullsized":"2024-09-11T01:12:58.129127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3638","last_scrub_stamp":"2024-09-11T01:12:58.128993+0000","last_deep_scrub":"29'3638","last_deep_scrub_stamp":"2024-09-11T01:12:58.128993+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.128993+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:14.412930+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":469010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'23","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.898427+0000","last_change":"2024-09-11T01:12:48.898427+0000","last_active":"2024-09-11T01:12:48.898427+0000","last_peered":"2024-09-11T01:12:48.898427+0000","last_clean":"2024-09-11T01:12:48.898427+0000","last_became_active":"2024-09-11T00:44:17.341813+0000","last_became_peered":"2024-09-11T00:44:17.341813+0000","last_unstale":"2024-09-11T01:12:48.898427+0000","last_undegraded":"2024-09-11T01:12:48.898427+0000","last_fullsized":"2024-09-11T01:12:48.898427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:48.898344+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:48.898344+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.898344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:21.686409+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'58","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.372494+0000","last_change":"2024-09-11T01:12:46.372438+0000","last_active":"2024-09-11T01:12:46.372494+0000","last_peered":"2024-09-11T01:12:46.372494+0000","last_clean":"2024-09-11T01:12:46.372494+0000","last_became_active":"2024-09-11T00:44:16.339935+0000","last_became_peered":"2024-09-11T00:44:16.339935+0000","last_unstale":"2024-09-11T01:12:46.372494+0000","last_undegraded":"2024-09-11T01:12:46.372494+0000","last_fullsized":"2024-09-11T01:12:46.372494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-11T01:12:46.372356+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-11T01:12:46.372356+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.372356+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.792276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94269,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":56,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4109","reported_seq":4149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.118921+0000","last_change":"2024-09-11T01:13:00.118921+0000","last_active":"2024-09-11T01:13:00.118921+0000","last_peered":"2024-09-11T01:13:00.118921+0000","last_clean":"2024-09-11T01:13:00.118921+0000","last_became_active":"2024-09-11T00:44:21.369760+0000","last_became_peered":"2024-09-11T00:44:21.369760+0000","last_unstale":"2024-09-11T01:13:00.118921+0000","last_undegraded":"2024-09-11T01:13:00.118921+0000","last_fullsized":"2024-09-11T01:13:00.118921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4109","last_scrub_stamp":"2024-09-11T01:13:00.118814+0000","last_deep_scrub":"29'4109","last_deep_scrub_stamp":"2024-09-11T01:13:00.118814+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.118814+0000","objects_scrubbed":0,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:32.906879+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21228,"num_write_kb":522753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.182978+0000","last_change":"2024-09-11T01:12:49.182910+0000","last_active":"2024-09-11T01:12:49.182978+0000","last_peered":"2024-09-11T01:12:49.182978+0000","last_clean":"2024-09-11T01:12:49.182978+0000","last_became_active":"2024-09-11T00:44:17.348046+0000","last_became_peered":"2024-09-11T00:44:17.348046+0000","last_unstale":"2024-09-11T01:12:49.182978+0000","last_undegraded":"2024-09-11T01:12:49.182978+0000","last_fullsized":"2024-09-11T01:12:49.182978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-09-11T01:12:49.182825+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-09-11T01:12:49.182825+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.182825+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:24:33.489820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'5","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.638487+0000","last_change":"2024-09-11T01:12:43.638487+0000","last_active":"2024-09-11T01:12:43.638487+0000","last_peered":"2024-09-11T01:12:43.638487+0000","last_clean":"2024-09-11T01:12:43.638487+0000","last_became_active":"2024-09-11T00:44:16.361181+0000","last_became_peered":"2024-09-11T00:44:16.361181+0000","last_unstale":"2024-09-11T01:12:43.638487+0000","last_undegraded":"2024-09-11T01:12:43.638487+0000","last_fullsized":"2024-09-11T01:12:43.638487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:43.638394+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:43.638394+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.638394+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:30.768656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'3208","reported_seq":3248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.983575+0000","last_change":"2024-09-11T01:13:00.983575+0000","last_active":"2024-09-11T01:13:00.983575+0000","last_peered":"2024-09-11T01:13:00.983575+0000","last_clean":"2024-09-11T01:13:00.983575+0000","last_became_active":"2024-09-11T00:44:21.384121+0000","last_became_peered":"2024-09-11T00:44:21.384121+0000","last_unstale":"2024-09-11T01:13:00.983575+0000","last_undegraded":"2024-09-11T01:13:00.983575+0000","last_fullsized":"2024-09-11T01:13:00.983575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3208","last_scrub_stamp":"2024-09-11T01:13:00.983473+0000","last_deep_scrub":"29'3208","last_deep_scrub_stamp":"2024-09-11T01:13:00.983473+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.983473+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:10.841241+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16393,"num_write_kb":421849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'16","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.373065+0000","last_change":"2024-09-11T01:12:52.373065+0000","last_active":"2024-09-11T01:12:52.373065+0000","last_peered":"2024-09-11T01:12:52.373065+0000","last_clean":"2024-09-11T01:12:52.373065+0000","last_became_active":"2024-09-11T00:44:17.339416+0000","last_became_peered":"2024-09-11T00:44:17.339416+0000","last_unstale":"2024-09-11T01:12:52.373065+0000","last_undegraded":"2024-09-11T01:12:52.373065+0000","last_fullsized":"2024-09-11T01:12:52.373065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:52.372960+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:52.372960+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.372960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:45.902728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.613917+0000","last_change":"2024-09-11T01:12:44.613855+0000","last_active":"2024-09-11T01:12:44.613917+0000","last_peered":"2024-09-11T01:12:44.613917+0000","last_clean":"2024-09-11T01:12:44.613917+0000","last_became_active":"2024-09-11T00:44:16.358017+0000","last_became_peered":"2024-09-11T00:44:16.358017+0000","last_unstale":"2024-09-11T01:12:44.613917+0000","last_undegraded":"2024-09-11T01:12:44.613917+0000","last_fullsized":"2024-09-11T01:12:44.613917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-09-11T01:12:44.613790+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-09-11T01:12:44.613790+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.613790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.521298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":147,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:42.666324+0000","last_change":"2024-09-11T01:12:42.666324+0000","last_active":"2024-09-11T01:12:42.666324+0000","last_peered":"2024-09-11T01:12:42.666324+0000","last_clean":"2024-09-11T01:12:42.666324+0000","last_became_active":"2024-09-11T00:44:07.614118+0000","last_became_peered":"2024-09-11T00:44:07.614118+0000","last_unstale":"2024-09-11T01:12:42.666324+0000","last_undegraded":"2024-09-11T01:12:42.666324+0000","last_fullsized":"2024-09-11T01:12:42.666324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-09-11T01:12:42.666220+0000","last_clean_scrub_stamp":"2024-09-11T01:12:42.666220+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:30.928859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'3437","reported_seq":3477,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:04.375776+0000","last_change":"2024-09-11T01:13:04.375776+0000","last_active":"2024-09-11T01:13:04.375776+0000","last_peered":"2024-09-11T01:13:04.375776+0000","last_clean":"2024-09-11T01:13:04.375776+0000","last_became_active":"2024-09-11T00:44:21.372701+0000","last_became_peered":"2024-09-11T00:44:21.372701+0000","last_unstale":"2024-09-11T01:13:04.375776+0000","last_undegraded":"2024-09-11T01:13:04.375776+0000","last_fullsized":"2024-09-11T01:13:04.375776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3437","last_scrub_stamp":"2024-09-11T01:13:04.375669+0000","last_deep_scrub":"29'3437","last_deep_scrub_stamp":"2024-09-11T01:13:04.375669+0000","last_clean_scrub_stamp":"2024-09-11T01:13:04.375669+0000","objects_scrubbed":0,"log_size":3437,"log_dups_size":0,"ondisk_log_size":3437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:31.561908+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":470069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.540017+0000","last_change":"2024-09-11T01:12:54.540017+0000","last_active":"2024-09-11T01:12:54.540017+0000","last_peered":"2024-09-11T01:12:54.540017+0000","last_clean":"2024-09-11T01:12:54.540017+0000","last_became_active":"2024-09-11T00:44:17.351375+0000","last_became_peered":"2024-09-11T00:44:17.351375+0000","last_unstale":"2024-09-11T01:12:54.540017+0000","last_undegraded":"2024-09-11T01:12:54.540017+0000","last_fullsized":"2024-09-11T01:12:54.540017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-11T01:12:54.539946+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-11T01:12:54.539946+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.539946+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:36.588222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.246253+0000","last_change":"2024-09-11T01:12:46.246253+0000","last_active":"2024-09-11T01:12:46.246253+0000","last_peered":"2024-09-11T01:12:46.246253+0000","last_clean":"2024-09-11T01:12:46.246253+0000","last_became_active":"2024-09-11T00:44:16.353278+0000","last_became_peered":"2024-09-11T00:44:16.353278+0000","last_unstale":"2024-09-11T01:12:46.246253+0000","last_undegraded":"2024-09-11T01:12:46.246253+0000","last_fullsized":"2024-09-11T01:12:46.246253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:46.246171+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:46.246171+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.246171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:12.122157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'3599","reported_seq":3639,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.746762+0000","last_change":"2024-09-11T01:12:49.746762+0000","last_active":"2024-09-11T01:12:49.746762+0000","last_peered":"2024-09-11T01:12:49.746762+0000","last_clean":"2024-09-11T01:12:49.746762+0000","last_became_active":"2024-09-11T00:44:21.377284+0000","last_became_peered":"2024-09-11T00:44:21.377284+0000","last_unstale":"2024-09-11T01:12:49.746762+0000","last_undegraded":"2024-09-11T01:12:49.746762+0000","last_fullsized":"2024-09-11T01:12:49.746762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3599","last_scrub_stamp":"2024-09-11T01:12:49.746662+0000","last_deep_scrub":"29'3599","last_deep_scrub_stamp":"2024-09-11T01:12:49.746662+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.746662+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:22.125292+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19227,"num_write_kb":482077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.205487+0000","last_change":"2024-09-11T01:12:49.205487+0000","last_active":"2024-09-11T01:12:49.205487+0000","last_peered":"2024-09-11T01:12:49.205487+0000","last_clean":"2024-09-11T01:12:49.205487+0000","last_became_active":"2024-09-11T00:44:17.360761+0000","last_became_peered":"2024-09-11T00:44:17.360761+0000","last_unstale":"2024-09-11T01:12:49.205487+0000","last_undegraded":"2024-09-11T01:12:49.205487+0000","last_fullsized":"2024-09-11T01:12:49.205487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:49.205391+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:49.205391+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.205391+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:17:44.978150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.871336+0000","last_change":"2024-09-11T01:12:47.871336+0000","last_active":"2024-09-11T01:12:47.871336+0000","last_peered":"2024-09-11T01:12:47.871336+0000","last_clean":"2024-09-11T01:12:47.871336+0000","last_became_active":"2024-09-11T00:44:16.346310+0000","last_became_peered":"2024-09-11T00:44:16.346310+0000","last_unstale":"2024-09-11T01:12:47.871336+0000","last_undegraded":"2024-09-11T01:12:47.871336+0000","last_fullsized":"2024-09-11T01:12:47.871336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:47.871242+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:47.871242+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.871242+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:33.283232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'3559","reported_seq":3598,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:02.020122+0000","last_change":"2024-09-11T01:13:02.020122+0000","last_active":"2024-09-11T01:13:02.020122+0000","last_peered":"2024-09-11T01:13:02.020122+0000","last_clean":"2024-09-11T01:13:02.020122+0000","last_became_active":"2024-09-11T00:44:21.380329+0000","last_became_peered":"2024-09-11T00:44:21.380329+0000","last_unstale":"2024-09-11T01:13:02.020122+0000","last_undegraded":"2024-09-11T01:13:02.020122+0000","last_fullsized":"2024-09-11T01:13:02.020122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3559","last_scrub_stamp":"2024-09-11T01:13:02.019900+0000","last_deep_scrub":"29'3559","last_deep_scrub_stamp":"2024-09-11T01:13:02.019900+0000","last_clean_scrub_stamp":"2024-09-11T01:13:02.019900+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:54.037592+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18451,"num_write_kb":454241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.136785+0000","last_change":"2024-09-11T01:12:51.136785+0000","last_active":"2024-09-11T01:12:51.136785+0000","last_peered":"2024-09-11T01:12:51.136785+0000","last_clean":"2024-09-11T01:12:51.136785+0000","last_became_active":"2024-09-11T00:44:17.348597+0000","last_became_peered":"2024-09-11T00:44:17.348597+0000","last_unstale":"2024-09-11T01:12:51.136785+0000","last_undegraded":"2024-09-11T01:12:51.136785+0000","last_fullsized":"2024-09-11T01:12:51.136785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:51.136698+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:51.136698+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.136698+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:26.880740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.395171+0000","last_change":"2024-09-11T01:12:45.395171+0000","last_active":"2024-09-11T01:12:45.395171+0000","last_peered":"2024-09-11T01:12:45.395171+0000","last_clean":"2024-09-11T01:12:45.395171+0000","last_became_active":"2024-09-11T00:44:16.349066+0000","last_became_peered":"2024-09-11T00:44:16.349066+0000","last_unstale":"2024-09-11T01:12:45.395171+0000","last_undegraded":"2024-09-11T01:12:45.395171+0000","last_fullsized":"2024-09-11T01:12:45.395171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-11T01:12:45.395087+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-11T01:12:45.395087+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.395087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:24.407410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'3432","reported_seq":3472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:05.358497+0000","last_change":"2024-09-11T01:13:05.358497+0000","last_active":"2024-09-11T01:13:05.358497+0000","last_peered":"2024-09-11T01:13:05.358497+0000","last_clean":"2024-09-11T01:13:05.358497+0000","last_became_active":"2024-09-11T00:44:21.369922+0000","last_became_peered":"2024-09-11T00:44:21.369922+0000","last_unstale":"2024-09-11T01:13:05.358497+0000","last_undegraded":"2024-09-11T01:13:05.358497+0000","last_fullsized":"2024-09-11T01:13:05.358497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3432","last_scrub_stamp":"2024-09-11T01:13:05.358381+0000","last_deep_scrub":"29'3432","last_deep_scrub_stamp":"2024-09-11T01:13:05.358381+0000","last_clean_scrub_stamp":"2024-09-11T01:13:05.358381+0000","objects_scrubbed":0,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:23.406167+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17982,"num_write_kb":456718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'12","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.749865+0000","last_change":"2024-09-11T01:12:54.749865+0000","last_active":"2024-09-11T01:12:54.749865+0000","last_peered":"2024-09-11T01:12:54.749865+0000","last_clean":"2024-09-11T01:12:54.749865+0000","last_became_active":"2024-09-11T00:44:17.347528+0000","last_became_peered":"2024-09-11T00:44:17.347528+0000","last_unstale":"2024-09-11T01:12:54.749865+0000","last_undegraded":"2024-09-11T01:12:54.749865+0000","last_fullsized":"2024-09-11T01:12:54.749865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-09-11T01:12:54.749790+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-09-11T01:12:54.749790+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.749790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:30.493832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.125495+0000","last_change":"2024-09-11T01:12:44.125495+0000","last_active":"2024-09-11T01:12:44.125495+0000","last_peered":"2024-09-11T01:12:44.125495+0000","last_clean":"2024-09-11T01:12:44.125495+0000","last_became_active":"2024-09-11T00:44:16.359729+0000","last_became_peered":"2024-09-11T00:44:16.359729+0000","last_unstale":"2024-09-11T01:12:44.125495+0000","last_undegraded":"2024-09-11T01:12:44.125495+0000","last_fullsized":"2024-09-11T01:12:44.125495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:44.125434+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:44.125434+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.125434+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:38.902700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'3441","reported_seq":3481,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.637346+0000","last_change":"2024-09-11T01:12:47.637346+0000","last_active":"2024-09-11T01:12:47.637346+0000","last_peered":"2024-09-11T01:12:47.637346+0000","last_clean":"2024-09-11T01:12:47.637346+0000","last_became_active":"2024-09-11T00:44:21.373449+0000","last_became_peered":"2024-09-11T00:44:21.373449+0000","last_unstale":"2024-09-11T01:12:47.637346+0000","last_undegraded":"2024-09-11T01:12:47.637346+0000","last_fullsized":"2024-09-11T01:12:47.637346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3441","last_scrub_stamp":"2024-09-11T01:12:47.637267+0000","last_deep_scrub":"29'3441","last_deep_scrub_stamp":"2024-09-11T01:12:47.637267+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.637267+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:29.355788+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18019,"num_write_kb":464925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.490863+0000","last_change":"2024-09-11T01:12:55.490863+0000","last_active":"2024-09-11T01:12:55.490863+0000","last_peered":"2024-09-11T01:12:55.490863+0000","last_clean":"2024-09-11T01:12:55.490863+0000","last_became_active":"2024-09-11T00:44:17.350095+0000","last_became_peered":"2024-09-11T00:44:17.350095+0000","last_unstale":"2024-09-11T01:12:55.490863+0000","last_undegraded":"2024-09-11T01:12:55.490863+0000","last_fullsized":"2024-09-11T01:12:55.490863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:55.490758+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:55.490758+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.490758+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:08.132380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'16","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.420547+0000","last_change":"2024-09-11T01:12:47.420547+0000","last_active":"2024-09-11T01:12:47.420547+0000","last_peered":"2024-09-11T01:12:47.420547+0000","last_clean":"2024-09-11T01:12:47.420547+0000","last_became_active":"2024-09-11T00:44:16.349454+0000","last_became_peered":"2024-09-11T00:44:16.349454+0000","last_unstale":"2024-09-11T01:12:47.420547+0000","last_undegraded":"2024-09-11T01:12:47.420547+0000","last_fullsized":"2024-09-11T01:12:47.420547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:47.420466+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:47.420466+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.420466+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:25.308126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'3762","reported_seq":3801,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:03.027620+0000","last_change":"2024-09-11T01:13:03.027551+0000","last_active":"2024-09-11T01:13:03.027620+0000","last_peered":"2024-09-11T01:13:03.027620+0000","last_clean":"2024-09-11T01:13:03.027620+0000","last_became_active":"2024-09-11T00:44:21.384130+0000","last_became_peered":"2024-09-11T00:44:21.384130+0000","last_unstale":"2024-09-11T01:13:03.027620+0000","last_undegraded":"2024-09-11T01:13:03.027620+0000","last_fullsized":"2024-09-11T01:13:03.027620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3762","last_scrub_stamp":"2024-09-11T01:13:03.027452+0000","last_deep_scrub":"29'3762","last_deep_scrub_stamp":"2024-09-11T01:13:03.027452+0000","last_clean_scrub_stamp":"2024-09-11T01:13:03.027452+0000","objects_scrubbed":0,"log_size":3762,"log_dups_size":0,"ondisk_log_size":3762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:53.888999+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19630,"num_write_kb":512267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:44.670219+0000","last_change":"2024-09-11T01:12:44.670219+0000","last_active":"2024-09-11T01:12:44.670219+0000","last_peered":"2024-09-11T01:12:44.670219+0000","last_clean":"2024-09-11T01:12:44.670219+0000","last_became_active":"2024-09-11T00:44:17.353879+0000","last_became_peered":"2024-09-11T00:44:17.353879+0000","last_unstale":"2024-09-11T01:12:44.670219+0000","last_undegraded":"2024-09-11T01:12:44.670219+0000","last_fullsized":"2024-09-11T01:12:44.670219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:44.670156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:44.670156+0000","last_clean_scrub_stamp":"2024-09-11T01:12:44.670156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:24.159459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.134910+0000","last_change":"2024-09-11T01:12:43.134910+0000","last_active":"2024-09-11T01:12:43.134910+0000","last_peered":"2024-09-11T01:12:43.134910+0000","last_clean":"2024-09-11T01:12:43.134910+0000","last_became_active":"2024-09-11T00:44:16.363476+0000","last_became_peered":"2024-09-11T00:44:16.363476+0000","last_unstale":"2024-09-11T01:12:43.134910+0000","last_undegraded":"2024-09-11T01:12:43.134910+0000","last_fullsized":"2024-09-11T01:12:43.134910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-09-11T01:12:43.134847+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-09-11T01:12:43.134847+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.134847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:30.258099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'3874","reported_seq":3913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:03.990732+0000","last_change":"2024-09-11T01:13:03.990662+0000","last_active":"2024-09-11T01:13:03.990732+0000","last_peered":"2024-09-11T01:13:03.990732+0000","last_clean":"2024-09-11T01:13:03.990732+0000","last_became_active":"2024-09-11T00:44:21.381503+0000","last_became_peered":"2024-09-11T00:44:21.381503+0000","last_unstale":"2024-09-11T01:13:03.990732+0000","last_undegraded":"2024-09-11T01:13:03.990732+0000","last_fullsized":"2024-09-11T01:13:03.990732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3874","last_scrub_stamp":"2024-09-11T01:13:03.990557+0000","last_deep_scrub":"29'3874","last_deep_scrub_stamp":"2024-09-11T01:13:03.990557+0000","last_clean_scrub_stamp":"2024-09-11T01:13:03.990557+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.426564+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20717,"num_write_kb":504326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.475479+0000","last_change":"2024-09-11T01:12:56.475479+0000","last_active":"2024-09-11T01:12:56.475479+0000","last_peered":"2024-09-11T01:12:56.475479+0000","last_clean":"2024-09-11T01:12:56.475479+0000","last_became_active":"2024-09-11T00:44:17.347860+0000","last_became_peered":"2024-09-11T00:44:17.347860+0000","last_unstale":"2024-09-11T01:12:56.475479+0000","last_undegraded":"2024-09-11T01:12:56.475479+0000","last_fullsized":"2024-09-11T01:12:56.475479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:56.475384+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:56.475384+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.475384+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:56.247268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.571482+0000","last_change":"2024-09-11T01:12:48.571482+0000","last_active":"2024-09-11T01:12:48.571482+0000","last_peered":"2024-09-11T01:12:48.571482+0000","last_clean":"2024-09-11T01:12:48.571482+0000","last_became_active":"2024-09-11T00:44:16.355701+0000","last_became_peered":"2024-09-11T00:44:16.355701+0000","last_unstale":"2024-09-11T01:12:48.571482+0000","last_undegraded":"2024-09-11T01:12:48.571482+0000","last_fullsized":"2024-09-11T01:12:48.571482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-09-11T01:12:48.571385+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-09-11T01:12:48.571385+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.571385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:58.700157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'3835","reported_seq":3874,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.146603+0000","last_change":"2024-09-11T01:12:59.146603+0000","last_active":"2024-09-11T01:12:59.146603+0000","last_peered":"2024-09-11T01:12:59.146603+0000","last_clean":"2024-09-11T01:12:59.146603+0000","last_became_active":"2024-09-11T00:44:21.373636+0000","last_became_peered":"2024-09-11T00:44:21.373636+0000","last_unstale":"2024-09-11T01:12:59.146603+0000","last_undegraded":"2024-09-11T01:12:59.146603+0000","last_fullsized":"2024-09-11T01:12:59.146603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3835","last_scrub_stamp":"2024-09-11T01:12:59.146505+0000","last_deep_scrub":"29'3835","last_deep_scrub_stamp":"2024-09-11T01:12:59.146505+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.146505+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:34.890547+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19523,"num_write_kb":520463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'24","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.197259+0000","last_change":"2024-09-11T01:12:50.197259+0000","last_active":"2024-09-11T01:12:50.197259+0000","last_peered":"2024-09-11T01:12:50.197259+0000","last_clean":"2024-09-11T01:12:50.197259+0000","last_became_active":"2024-09-11T00:44:17.356814+0000","last_became_peered":"2024-09-11T00:44:17.356814+0000","last_unstale":"2024-09-11T01:12:50.197259+0000","last_undegraded":"2024-09-11T01:12:50.197259+0000","last_fullsized":"2024-09-11T01:12:50.197259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:50.197175+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:50.197175+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.197175+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:57.831144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.345041+0000","last_change":"2024-09-11T01:12:47.345041+0000","last_active":"2024-09-11T01:12:47.345041+0000","last_peered":"2024-09-11T01:12:47.345041+0000","last_clean":"2024-09-11T01:12:47.345041+0000","last_became_active":"2024-09-11T00:44:16.363237+0000","last_became_peered":"2024-09-11T00:44:16.363237+0000","last_unstale":"2024-09-11T01:12:47.345041+0000","last_undegraded":"2024-09-11T01:12:47.345041+0000","last_fullsized":"2024-09-11T01:12:47.345041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-09-11T01:12:47.344954+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-09-11T01:12:47.344954+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.344954+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:37.137294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'3484","reported_seq":3523,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:08.337334+0000","last_change":"2024-09-11T01:13:08.337273+0000","last_active":"2024-09-11T01:13:08.337334+0000","last_peered":"2024-09-11T01:13:08.337334+0000","last_clean":"2024-09-11T01:13:08.337334+0000","last_became_active":"2024-09-11T00:44:21.386540+0000","last_became_peered":"2024-09-11T00:44:21.386540+0000","last_unstale":"2024-09-11T01:13:08.337334+0000","last_undegraded":"2024-09-11T01:13:08.337334+0000","last_fullsized":"2024-09-11T01:13:08.337334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3484","last_scrub_stamp":"2024-09-11T01:13:08.337174+0000","last_deep_scrub":"29'3484","last_deep_scrub_stamp":"2024-09-11T01:13:08.337174+0000","last_clean_scrub_stamp":"2024-09-11T01:13:08.337174+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:01.589323+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17966,"num_write_kb":460557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'17","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.195957+0000","last_change":"2024-09-11T01:12:48.195854+0000","last_active":"2024-09-11T01:12:48.195957+0000","last_peered":"2024-09-11T01:12:48.195957+0000","last_clean":"2024-09-11T01:12:48.195957+0000","last_became_active":"2024-09-11T00:44:17.351655+0000","last_became_peered":"2024-09-11T00:44:17.351655+0000","last_unstale":"2024-09-11T01:12:48.195957+0000","last_undegraded":"2024-09-11T01:12:48.195957+0000","last_fullsized":"2024-09-11T01:12:48.195957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:48.195765+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:48.195765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.195765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:56.881174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'370","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.669959+0000","last_change":"2024-09-11T01:12:43.669959+0000","last_active":"2024-09-11T01:12:43.669959+0000","last_peered":"2024-09-11T01:12:43.669959+0000","last_clean":"2024-09-11T01:12:43.669959+0000","last_became_active":"2024-09-11T00:44:16.349790+0000","last_became_peered":"2024-09-11T00:44:16.349790+0000","last_unstale":"2024-09-11T01:12:43.669959+0000","last_undegraded":"2024-09-11T01:12:43.669959+0000","last_fullsized":"2024-09-11T01:12:43.669959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'370","last_scrub_stamp":"2024-09-11T01:12:43.669899+0000","last_deep_scrub":"29'370","last_deep_scrub_stamp":"2024-09-11T01:12:43.669899+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.669899+0000","objects_scrubbed":4,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:20.216294+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'3549","reported_seq":3588,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.330977+0000","last_change":"2024-09-11T01:12:58.330977+0000","last_active":"2024-09-11T01:12:58.330977+0000","last_peered":"2024-09-11T01:12:58.330977+0000","last_clean":"2024-09-11T01:12:58.330977+0000","last_became_active":"2024-09-11T00:44:21.374135+0000","last_became_peered":"2024-09-11T00:44:21.374135+0000","last_unstale":"2024-09-11T01:12:58.330977+0000","last_undegraded":"2024-09-11T01:12:58.330977+0000","last_fullsized":"2024-09-11T01:12:58.330977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3549","last_scrub_stamp":"2024-09-11T01:12:58.330880+0000","last_deep_scrub":"29'3549","last_deep_scrub_stamp":"2024-09-11T01:12:58.330880+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.330880+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:06.574851+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":475498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.482452+0000","last_change":"2024-09-11T01:12:57.482452+0000","last_active":"2024-09-11T01:12:57.482452+0000","last_peered":"2024-09-11T01:12:57.482452+0000","last_clean":"2024-09-11T01:12:57.482452+0000","last_became_active":"2024-09-11T00:44:17.350291+0000","last_became_peered":"2024-09-11T00:44:17.350291+0000","last_unstale":"2024-09-11T01:12:57.482452+0000","last_undegraded":"2024-09-11T01:12:57.482452+0000","last_fullsized":"2024-09-11T01:12:57.482452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:57.482348+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:57.482348+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.482348+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:12.800580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.321137+0000","last_change":"2024-09-11T01:12:48.321059+0000","last_active":"2024-09-11T01:12:48.321137+0000","last_peered":"2024-09-11T01:12:48.321137+0000","last_clean":"2024-09-11T01:12:48.321137+0000","last_became_active":"2024-09-11T00:44:16.352566+0000","last_became_peered":"2024-09-11T00:44:16.352566+0000","last_unstale":"2024-09-11T01:12:48.321137+0000","last_undegraded":"2024-09-11T01:12:48.321137+0000","last_fullsized":"2024-09-11T01:12:48.321137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-11T01:12:48.320971+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-11T01:12:48.320971+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.320971+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:52.990755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'3729","reported_seq":3768,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.738545+0000","last_change":"2024-09-11T01:12:50.738545+0000","last_active":"2024-09-11T01:12:50.738545+0000","last_peered":"2024-09-11T01:12:50.738545+0000","last_clean":"2024-09-11T01:12:50.738545+0000","last_became_active":"2024-09-11T00:44:21.375673+0000","last_became_peered":"2024-09-11T00:44:21.375673+0000","last_unstale":"2024-09-11T01:12:50.738545+0000","last_undegraded":"2024-09-11T01:12:50.738545+0000","last_fullsized":"2024-09-11T01:12:50.738545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3729","last_scrub_stamp":"2024-09-11T01:12:50.738443+0000","last_deep_scrub":"29'3729","last_deep_scrub_stamp":"2024-09-11T01:12:50.738443+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.738443+0000","objects_scrubbed":0,"log_size":3729,"log_dups_size":0,"ondisk_log_size":3729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:45.881611+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19421,"num_write_kb":490905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'25","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.946597+0000","last_change":"2024-09-11T01:12:49.946518+0000","last_active":"2024-09-11T01:12:49.946597+0000","last_peered":"2024-09-11T01:12:49.946597+0000","last_clean":"2024-09-11T01:12:49.946597+0000","last_became_active":"2024-09-11T00:44:17.352921+0000","last_became_peered":"2024-09-11T00:44:17.352921+0000","last_unstale":"2024-09-11T01:12:49.946597+0000","last_undegraded":"2024-09-11T01:12:49.946597+0000","last_fullsized":"2024-09-11T01:12:49.946597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:49.946436+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:49.946436+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.946436+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:59.280897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.163647+0000","last_change":"2024-09-11T01:12:50.163580+0000","last_active":"2024-09-11T01:12:50.163647+0000","last_peered":"2024-09-11T01:12:50.163647+0000","last_clean":"2024-09-11T01:12:50.163647+0000","last_became_active":"2024-09-11T00:44:16.366961+0000","last_became_peered":"2024-09-11T00:44:16.366961+0000","last_unstale":"2024-09-11T01:12:50.163647+0000","last_undegraded":"2024-09-11T01:12:50.163647+0000","last_fullsized":"2024-09-11T01:12:50.163647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:50.163462+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:50.163462+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.163462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:06.447399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'3484","reported_seq":3523,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.414059+0000","last_change":"2024-09-11T01:12:55.414059+0000","last_active":"2024-09-11T01:12:55.414059+0000","last_peered":"2024-09-11T01:12:55.414059+0000","last_clean":"2024-09-11T01:12:55.414059+0000","last_became_active":"2024-09-11T00:44:21.380015+0000","last_became_peered":"2024-09-11T00:44:21.380015+0000","last_unstale":"2024-09-11T01:12:55.414059+0000","last_undegraded":"2024-09-11T01:12:55.414059+0000","last_fullsized":"2024-09-11T01:12:55.414059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3484","last_scrub_stamp":"2024-09-11T01:12:55.413964+0000","last_deep_scrub":"29'3484","last_deep_scrub_stamp":"2024-09-11T01:12:55.413964+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.413964+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:00.033617+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18366,"num_write_kb":470391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'25","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.791260+0000","last_change":"2024-09-11T01:12:55.791194+0000","last_active":"2024-09-11T01:12:55.791260+0000","last_peered":"2024-09-11T01:12:55.791260+0000","last_clean":"2024-09-11T01:12:55.791260+0000","last_became_active":"2024-09-11T00:44:17.352913+0000","last_became_peered":"2024-09-11T00:44:17.352913+0000","last_unstale":"2024-09-11T01:12:55.791260+0000","last_undegraded":"2024-09-11T01:12:55.791260+0000","last_fullsized":"2024-09-11T01:12:55.791260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:55.791120+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:55.791120+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.791120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:28.579185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:43.671571+0000","last_change":"2024-09-11T01:12:43.671524+0000","last_active":"2024-09-11T01:12:43.671571+0000","last_peered":"2024-09-11T01:12:43.671571+0000","last_clean":"2024-09-11T01:12:43.671571+0000","last_became_active":"2024-09-11T00:44:16.350093+0000","last_became_peered":"2024-09-11T00:44:16.350093+0000","last_unstale":"2024-09-11T01:12:43.671571+0000","last_undegraded":"2024-09-11T01:12:43.671571+0000","last_fullsized":"2024-09-11T01:12:43.671571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-11T01:12:43.671469+0000","last_clean_scrub_stamp":"2024-09-11T01:12:43.671469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:19.723350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'3980","reported_seq":4019,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.368784+0000","last_change":"2024-09-11T01:12:57.368784+0000","last_active":"2024-09-11T01:12:57.368784+0000","last_peered":"2024-09-11T01:12:57.368784+0000","last_clean":"2024-09-11T01:12:57.368784+0000","last_became_active":"2024-09-11T00:44:21.375412+0000","last_became_peered":"2024-09-11T00:44:21.375412+0000","last_unstale":"2024-09-11T01:12:57.368784+0000","last_undegraded":"2024-09-11T01:12:57.368784+0000","last_fullsized":"2024-09-11T01:12:57.368784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3980","last_scrub_stamp":"2024-09-11T01:12:57.368670+0000","last_deep_scrub":"29'3980","last_deep_scrub_stamp":"2024-09-11T01:12:57.368670+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.368670+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:46.771596+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20439,"num_write_kb":490946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4320","reported_seq":4361,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.301395+0000","last_change":"2024-09-11T01:13:00.301395+0000","last_active":"2024-09-11T01:13:00.301395+0000","last_peered":"2024-09-11T01:13:00.301395+0000","last_clean":"2024-09-11T01:13:00.301395+0000","last_became_active":"2024-09-11T00:44:21.386823+0000","last_became_peered":"2024-09-11T00:44:21.386823+0000","last_unstale":"2024-09-11T01:13:00.301395+0000","last_undegraded":"2024-09-11T01:13:00.301395+0000","last_fullsized":"2024-09-11T01:13:00.301395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4320","last_scrub_stamp":"2024-09-11T01:13:00.301295+0000","last_deep_scrub":"29'4320","last_deep_scrub_stamp":"2024-09-11T01:13:00.301295+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.301295+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:26.936275+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23081,"num_write_kb":567146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'20","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.397353+0000","last_change":"2024-09-11T01:12:53.397261+0000","last_active":"2024-09-11T01:12:53.397353+0000","last_peered":"2024-09-11T01:12:53.397353+0000","last_clean":"2024-09-11T01:12:53.397353+0000","last_became_active":"2024-09-11T00:44:17.351305+0000","last_became_peered":"2024-09-11T00:44:17.351305+0000","last_unstale":"2024-09-11T01:12:53.397353+0000","last_undegraded":"2024-09-11T01:12:53.397353+0000","last_fullsized":"2024-09-11T01:12:53.397353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:53.397175+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:53.397175+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.397175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:41.647653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.595702+0000","last_change":"2024-09-11T01:12:47.595649+0000","last_active":"2024-09-11T01:12:47.595702+0000","last_peered":"2024-09-11T01:12:47.595702+0000","last_clean":"2024-09-11T01:12:47.595702+0000","last_became_active":"2024-09-11T00:44:16.361614+0000","last_became_peered":"2024-09-11T00:44:16.361614+0000","last_unstale":"2024-09-11T01:12:47.595702+0000","last_undegraded":"2024-09-11T01:12:47.595702+0000","last_fullsized":"2024-09-11T01:12:47.595702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:47.595583+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:47.595583+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.595583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:29.975829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'3654","reported_seq":3694,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:06.319231+0000","last_change":"2024-09-11T01:13:06.319231+0000","last_active":"2024-09-11T01:13:06.319231+0000","last_peered":"2024-09-11T01:13:06.319231+0000","last_clean":"2024-09-11T01:13:06.319231+0000","last_became_active":"2024-09-11T00:44:21.384592+0000","last_became_peered":"2024-09-11T00:44:21.384592+0000","last_unstale":"2024-09-11T01:13:06.319231+0000","last_undegraded":"2024-09-11T01:13:06.319231+0000","last_fullsized":"2024-09-11T01:13:06.319231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3654","last_scrub_stamp":"2024-09-11T01:13:06.319124+0000","last_deep_scrub":"29'3654","last_deep_scrub_stamp":"2024-09-11T01:13:06.319124+0000","last_clean_scrub_stamp":"2024-09-11T01:13:06.319124+0000","objects_scrubbed":0,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:06.415185+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19240,"num_write_kb":498485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'27","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.930377+0000","last_change":"2024-09-11T01:12:50.930312+0000","last_active":"2024-09-11T01:12:50.930377+0000","last_peered":"2024-09-11T01:12:50.930377+0000","last_clean":"2024-09-11T01:12:50.930377+0000","last_became_active":"2024-09-11T00:44:17.349345+0000","last_became_peered":"2024-09-11T00:44:17.349345+0000","last_unstale":"2024-09-11T01:12:50.930377+0000","last_undegraded":"2024-09-11T01:12:50.930377+0000","last_fullsized":"2024-09-11T01:12:50.930377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:50.930241+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:50.930241+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.930241+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:34.201227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.198465+0000","last_change":"2024-09-11T01:12:48.198400+0000","last_active":"2024-09-11T01:12:48.198465+0000","last_peered":"2024-09-11T01:12:48.198465+0000","last_clean":"2024-09-11T01:12:48.198465+0000","last_became_active":"2024-09-11T00:44:16.352589+0000","last_became_peered":"2024-09-11T00:44:16.352589+0000","last_unstale":"2024-09-11T01:12:48.198465+0000","last_undegraded":"2024-09-11T01:12:48.198465+0000","last_fullsized":"2024-09-11T01:12:48.198465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-11T01:12:48.198324+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-11T01:12:48.198324+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.198324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:24.744720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.582077+0000","last_change":"2024-09-11T01:12:49.582077+0000","last_active":"2024-09-11T01:12:49.582077+0000","last_peered":"2024-09-11T01:12:49.582077+0000","last_clean":"2024-09-11T01:12:49.582077+0000","last_became_active":"2024-09-11T00:44:16.359451+0000","last_became_peered":"2024-09-11T00:44:16.359451+0000","last_unstale":"2024-09-11T01:12:49.582077+0000","last_undegraded":"2024-09-11T01:12:49.582077+0000","last_fullsized":"2024-09-11T01:12:49.582077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-09-11T01:12:49.581998+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-09-11T01:12:49.581998+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.581998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:43.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'19","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.355545+0000","last_change":"2024-09-11T01:12:54.355545+0000","last_active":"2024-09-11T01:12:54.355545+0000","last_peered":"2024-09-11T01:12:54.355545+0000","last_clean":"2024-09-11T01:12:54.355545+0000","last_became_active":"2024-09-11T00:44:17.351185+0000","last_became_peered":"2024-09-11T00:44:17.351185+0000","last_unstale":"2024-09-11T01:12:54.355545+0000","last_undegraded":"2024-09-11T01:12:54.355545+0000","last_fullsized":"2024-09-11T01:12:54.355545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:54.355472+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:54.355472+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.355472+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:38.543149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3030","reported_seq":3068,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.329159+0000","last_change":"2024-09-11T01:12:59.329159+0000","last_active":"2024-09-11T01:12:59.329159+0000","last_peered":"2024-09-11T01:12:59.329159+0000","last_clean":"2024-09-11T01:12:59.329159+0000","last_became_active":"2024-09-11T00:44:21.376043+0000","last_became_peered":"2024-09-11T00:44:21.376043+0000","last_unstale":"2024-09-11T01:12:59.329159+0000","last_undegraded":"2024-09-11T01:12:59.329159+0000","last_fullsized":"2024-09-11T01:12:59.329159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3030","last_scrub_stamp":"2024-09-11T01:12:59.329043+0000","last_deep_scrub":"29'3030","last_deep_scrub_stamp":"2024-09-11T01:12:59.329043+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.329043+0000","objects_scrubbed":0,"log_size":3030,"log_dups_size":0,"ondisk_log_size":3030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:48.409796+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15804,"num_write_kb":394778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'609","reported_seq":655,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.897182+0000","last_change":"2024-09-11T01:12:46.897182+0000","last_active":"2024-09-11T01:12:46.897182+0000","last_peered":"2024-09-11T01:12:46.897182+0000","last_clean":"2024-09-11T01:12:46.897182+0000","last_became_active":"2024-09-11T00:44:16.344322+0000","last_became_peered":"2024-09-11T00:44:16.344322+0000","last_unstale":"2024-09-11T01:12:46.897182+0000","last_undegraded":"2024-09-11T01:12:46.897182+0000","last_fullsized":"2024-09-11T01:12:46.897182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'609","last_scrub_stamp":"2024-09-11T01:12:46.897060+0000","last_deep_scrub":"29'609","last_deep_scrub_stamp":"2024-09-11T01:12:46.897060+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.897060+0000","objects_scrubbed":1,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:10.906240+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":606,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'20","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.706544+0000","last_change":"2024-09-11T01:12:45.706544+0000","last_active":"2024-09-11T01:12:45.706544+0000","last_peered":"2024-09-11T01:12:45.706544+0000","last_clean":"2024-09-11T01:12:45.706544+0000","last_became_active":"2024-09-11T00:44:17.352766+0000","last_became_peered":"2024-09-11T00:44:17.352766+0000","last_unstale":"2024-09-11T01:12:45.706544+0000","last_undegraded":"2024-09-11T01:12:45.706544+0000","last_fullsized":"2024-09-11T01:12:45.706544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-11T01:12:45.706481+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-11T01:12:45.706481+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.706481+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.291495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'3873","reported_seq":3911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.406904+0000","last_change":"2024-09-11T01:12:54.406904+0000","last_active":"2024-09-11T01:12:54.406904+0000","last_peered":"2024-09-11T01:12:54.406904+0000","last_clean":"2024-09-11T01:12:54.406904+0000","last_became_active":"2024-09-11T00:44:21.382466+0000","last_became_peered":"2024-09-11T00:44:21.382466+0000","last_unstale":"2024-09-11T01:12:54.406904+0000","last_undegraded":"2024-09-11T01:12:54.406904+0000","last_fullsized":"2024-09-11T01:12:54.406904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3873","last_scrub_stamp":"2024-09-11T01:12:54.406766+0000","last_deep_scrub":"29'3873","last_deep_scrub_stamp":"2024-09-11T01:12:54.406766+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.406766+0000","objects_scrubbed":0,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:18.705454+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20299,"num_write_kb":535396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'24","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:45.654872+0000","last_change":"2024-09-11T01:12:45.654823+0000","last_active":"2024-09-11T01:12:45.654872+0000","last_peered":"2024-09-11T01:12:45.654872+0000","last_clean":"2024-09-11T01:12:45.654872+0000","last_became_active":"2024-09-11T00:44:17.359520+0000","last_became_peered":"2024-09-11T00:44:17.359520+0000","last_unstale":"2024-09-11T01:12:45.654872+0000","last_undegraded":"2024-09-11T01:12:45.654872+0000","last_fullsized":"2024-09-11T01:12:45.654872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:45.654757+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:45.654757+0000","last_clean_scrub_stamp":"2024-09-11T01:12:45.654757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:25.061395+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'25","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:50.335958+0000","last_change":"2024-09-11T01:12:50.335958+0000","last_active":"2024-09-11T01:12:50.335958+0000","last_peered":"2024-09-11T01:12:50.335958+0000","last_clean":"2024-09-11T01:12:50.335958+0000","last_became_active":"2024-09-11T00:44:17.348625+0000","last_became_peered":"2024-09-11T00:44:17.348625+0000","last_unstale":"2024-09-11T01:12:50.335958+0000","last_undegraded":"2024-09-11T01:12:50.335958+0000","last_fullsized":"2024-09-11T01:12:50.335958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:50.335868+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:50.335868+0000","last_clean_scrub_stamp":"2024-09-11T01:12:50.335868+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.878109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'23","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.392950+0000","last_change":"2024-09-11T01:12:59.392950+0000","last_active":"2024-09-11T01:12:59.392950+0000","last_peered":"2024-09-11T01:12:59.392950+0000","last_clean":"2024-09-11T01:12:59.392950+0000","last_became_active":"2024-09-11T00:44:17.356636+0000","last_became_peered":"2024-09-11T00:44:17.356636+0000","last_unstale":"2024-09-11T01:12:59.392950+0000","last_undegraded":"2024-09-11T01:12:59.392950+0000","last_fullsized":"2024-09-11T01:12:59.392950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:59.392874+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:59.392874+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.392874+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:36.890952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.950793+0000","last_change":"2024-09-11T01:12:54.950793+0000","last_active":"2024-09-11T01:12:54.950793+0000","last_peered":"2024-09-11T01:12:54.950793+0000","last_clean":"2024-09-11T01:12:54.950793+0000","last_became_active":"2024-09-11T00:44:17.343632+0000","last_became_peered":"2024-09-11T00:44:17.343632+0000","last_unstale":"2024-09-11T01:12:54.950793+0000","last_undegraded":"2024-09-11T01:12:54.950793+0000","last_fullsized":"2024-09-11T01:12:54.950793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:54.950714+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:54.950714+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.950714+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:12.687187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.152979+0000","last_change":"2024-09-11T01:12:54.152979+0000","last_active":"2024-09-11T01:12:54.152979+0000","last_peered":"2024-09-11T01:12:54.152979+0000","last_clean":"2024-09-11T01:12:54.152979+0000","last_became_active":"2024-09-11T00:44:17.345200+0000","last_became_peered":"2024-09-11T00:44:17.345200+0000","last_unstale":"2024-09-11T01:12:54.152979+0000","last_undegraded":"2024-09-11T01:12:54.152979+0000","last_fullsized":"2024-09-11T01:12:54.152979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:54.152901+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:54.152901+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.152901+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:26.531531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'15","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:51.163818+0000","last_change":"2024-09-11T01:12:51.163818+0000","last_active":"2024-09-11T01:12:51.163818+0000","last_peered":"2024-09-11T01:12:51.163818+0000","last_clean":"2024-09-11T01:12:51.163818+0000","last_became_active":"2024-09-11T00:44:17.347490+0000","last_became_peered":"2024-09-11T00:44:17.347490+0000","last_unstale":"2024-09-11T01:12:51.163818+0000","last_undegraded":"2024-09-11T01:12:51.163818+0000","last_fullsized":"2024-09-11T01:12:51.163818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-09-11T01:12:51.163726+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-09-11T01:12:51.163726+0000","last_clean_scrub_stamp":"2024-09-11T01:12:51.163726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:07.700622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'24","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.834233+0000","last_change":"2024-09-11T01:12:56.834233+0000","last_active":"2024-09-11T01:12:56.834233+0000","last_peered":"2024-09-11T01:12:56.834233+0000","last_clean":"2024-09-11T01:12:56.834233+0000","last_became_active":"2024-09-11T00:44:17.353256+0000","last_became_peered":"2024-09-11T00:44:17.353256+0000","last_unstale":"2024-09-11T01:12:56.834233+0000","last_undegraded":"2024-09-11T01:12:56.834233+0000","last_fullsized":"2024-09-11T01:12:56.834233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:56.834136+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:56.834136+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.834136+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:35.485490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'17","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.913414+0000","last_change":"2024-09-11T01:12:53.913414+0000","last_active":"2024-09-11T01:12:53.913414+0000","last_peered":"2024-09-11T01:12:53.913414+0000","last_clean":"2024-09-11T01:12:53.913414+0000","last_became_active":"2024-09-11T00:44:17.344839+0000","last_became_peered":"2024-09-11T00:44:17.344839+0000","last_unstale":"2024-09-11T01:12:53.913414+0000","last_undegraded":"2024-09-11T01:12:53.913414+0000","last_fullsized":"2024-09-11T01:12:53.913414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:53.913304+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:53.913304+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.913304+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.941511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'18","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:00.398577+0000","last_change":"2024-09-11T01:13:00.398577+0000","last_active":"2024-09-11T01:13:00.398577+0000","last_peered":"2024-09-11T01:13:00.398577+0000","last_clean":"2024-09-11T01:13:00.398577+0000","last_became_active":"2024-09-11T00:44:17.355419+0000","last_became_peered":"2024-09-11T00:44:17.355419+0000","last_unstale":"2024-09-11T01:13:00.398577+0000","last_undegraded":"2024-09-11T01:13:00.398577+0000","last_fullsized":"2024-09-11T01:13:00.398577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:13:00.398501+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:13:00.398501+0000","last_clean_scrub_stamp":"2024-09-11T01:13:00.398501+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:30.625471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'23","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.963849+0000","last_change":"2024-09-11T01:12:55.963849+0000","last_active":"2024-09-11T01:12:55.963849+0000","last_peered":"2024-09-11T01:12:55.963849+0000","last_clean":"2024-09-11T01:12:55.963849+0000","last_became_active":"2024-09-11T00:44:17.337760+0000","last_became_peered":"2024-09-11T00:44:17.337760+0000","last_unstale":"2024-09-11T01:12:55.963849+0000","last_undegraded":"2024-09-11T01:12:55.963849+0000","last_fullsized":"2024-09-11T01:12:55.963849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:55.963765+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:55.963765+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.963765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:27.888441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'23","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:48.663725+0000","last_change":"2024-09-11T01:12:48.663725+0000","last_active":"2024-09-11T01:12:48.663725+0000","last_peered":"2024-09-11T01:12:48.663725+0000","last_clean":"2024-09-11T01:12:48.663725+0000","last_became_active":"2024-09-11T00:44:17.351136+0000","last_became_peered":"2024-09-11T00:44:17.351136+0000","last_unstale":"2024-09-11T01:12:48.663725+0000","last_undegraded":"2024-09-11T01:12:48.663725+0000","last_fullsized":"2024-09-11T01:12:48.663725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-11T01:12:48.663642+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-11T01:12:48.663642+0000","last_clean_scrub_stamp":"2024-09-11T01:12:48.663642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:14.306206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'28","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.329472+0000","last_change":"2024-09-11T01:12:55.329472+0000","last_active":"2024-09-11T01:12:55.329472+0000","last_peered":"2024-09-11T01:12:55.329472+0000","last_clean":"2024-09-11T01:12:55.329472+0000","last_became_active":"2024-09-11T00:44:17.347559+0000","last_became_peered":"2024-09-11T00:44:17.347559+0000","last_unstale":"2024-09-11T01:12:55.329472+0000","last_undegraded":"2024-09-11T01:12:55.329472+0000","last_fullsized":"2024-09-11T01:12:55.329472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-11T01:12:55.329366+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-11T01:12:55.329366+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.329366+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:58.634535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'19","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.170096+0000","last_change":"2024-09-11T01:12:52.170096+0000","last_active":"2024-09-11T01:12:52.170096+0000","last_peered":"2024-09-11T01:12:52.170096+0000","last_clean":"2024-09-11T01:12:52.170096+0000","last_became_active":"2024-09-11T00:44:17.350069+0000","last_became_peered":"2024-09-11T00:44:17.350069+0000","last_unstale":"2024-09-11T01:12:52.170096+0000","last_undegraded":"2024-09-11T01:12:52.170096+0000","last_fullsized":"2024-09-11T01:12:52.170096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:52.170011+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:52.170011+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.170011+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:24.958076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'22","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:01.446902+0000","last_change":"2024-09-11T01:13:01.446902+0000","last_active":"2024-09-11T01:13:01.446902+0000","last_peered":"2024-09-11T01:13:01.446902+0000","last_clean":"2024-09-11T01:13:01.446902+0000","last_became_active":"2024-09-11T00:44:17.350678+0000","last_became_peered":"2024-09-11T00:44:17.350678+0000","last_unstale":"2024-09-11T01:13:01.446902+0000","last_undegraded":"2024-09-11T01:13:01.446902+0000","last_fullsized":"2024-09-11T01:13:01.446902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-11T01:13:01.446785+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-11T01:13:01.446785+0000","last_clean_scrub_stamp":"2024-09-11T01:13:01.446785+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:51.791215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:49.315601+0000","last_change":"2024-09-11T01:12:49.315601+0000","last_active":"2024-09-11T01:12:49.315601+0000","last_peered":"2024-09-11T01:12:49.315601+0000","last_clean":"2024-09-11T01:12:49.315601+0000","last_became_active":"2024-09-11T00:44:17.352031+0000","last_became_peered":"2024-09-11T00:44:17.352031+0000","last_unstale":"2024-09-11T01:12:49.315601+0000","last_undegraded":"2024-09-11T01:12:49.315601+0000","last_fullsized":"2024-09-11T01:12:49.315601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:49.315529+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:49.315529+0000","last_clean_scrub_stamp":"2024-09-11T01:12:49.315529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:39.514037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:03.403505+0000","last_change":"2024-09-11T01:13:03.403505+0000","last_active":"2024-09-11T01:13:03.403505+0000","last_peered":"2024-09-11T01:13:03.403505+0000","last_clean":"2024-09-11T01:13:03.403505+0000","last_became_active":"2024-09-11T00:44:17.366067+0000","last_became_peered":"2024-09-11T00:44:17.366067+0000","last_unstale":"2024-09-11T01:13:03.403505+0000","last_undegraded":"2024-09-11T01:13:03.403505+0000","last_fullsized":"2024-09-11T01:13:03.403505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:13:03.403415+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:13:03.403415+0000","last_clean_scrub_stamp":"2024-09-11T01:13:03.403415+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:39.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:13:02.409901+0000","last_change":"2024-09-11T01:13:02.409901+0000","last_active":"2024-09-11T01:13:02.409901+0000","last_peered":"2024-09-11T01:13:02.409901+0000","last_clean":"2024-09-11T01:13:02.409901+0000","last_became_active":"2024-09-11T00:44:17.348310+0000","last_became_peered":"2024-09-11T00:44:17.348310+0000","last_unstale":"2024-09-11T01:13:02.409901+0000","last_undegraded":"2024-09-11T01:13:02.409901+0000","last_fullsized":"2024-09-11T01:13:02.409901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:13:02.409821+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:13:02.409821+0000","last_clean_scrub_stamp":"2024-09-11T01:13:02.409821+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:53.338067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'21","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.004394+0000","last_change":"2024-09-11T01:12:57.004394+0000","last_active":"2024-09-11T01:12:57.004394+0000","last_peered":"2024-09-11T01:12:57.004394+0000","last_clean":"2024-09-11T01:12:57.004394+0000","last_became_active":"2024-09-11T00:44:17.349727+0000","last_became_peered":"2024-09-11T00:44:17.349727+0000","last_unstale":"2024-09-11T01:12:57.004394+0000","last_undegraded":"2024-09-11T01:12:57.004394+0000","last_fullsized":"2024-09-11T01:12:57.004394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-11T01:12:57.004279+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-11T01:12:57.004279+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.004279+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:54.283518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'24","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:52.187195+0000","last_change":"2024-09-11T01:12:52.187195+0000","last_active":"2024-09-11T01:12:52.187195+0000","last_peered":"2024-09-11T01:12:52.187195+0000","last_clean":"2024-09-11T01:12:52.187195+0000","last_became_active":"2024-09-11T00:44:17.352699+0000","last_became_peered":"2024-09-11T00:44:17.352699+0000","last_unstale":"2024-09-11T01:12:52.187195+0000","last_undegraded":"2024-09-11T01:12:52.187195+0000","last_fullsized":"2024-09-11T01:12:52.187195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-11T01:12:52.187116+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-11T01:12:52.187116+0000","last_clean_scrub_stamp":"2024-09-11T01:12:52.187116+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.964382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'25","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.106781+0000","last_change":"2024-09-11T01:12:55.106690+0000","last_active":"2024-09-11T01:12:55.106781+0000","last_peered":"2024-09-11T01:12:55.106781+0000","last_clean":"2024-09-11T01:12:55.106781+0000","last_became_active":"2024-09-11T00:44:17.350521+0000","last_became_peered":"2024-09-11T00:44:17.350521+0000","last_unstale":"2024-09-11T01:12:55.106781+0000","last_undegraded":"2024-09-11T01:12:55.106781+0000","last_fullsized":"2024-09-11T01:12:55.106781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-11T01:12:55.106568+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-11T01:12:55.106568+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.106568+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:50.249736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'17","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:54.150576+0000","last_change":"2024-09-11T01:12:54.150506+0000","last_active":"2024-09-11T01:12:54.150576+0000","last_peered":"2024-09-11T01:12:54.150576+0000","last_clean":"2024-09-11T01:12:54.150576+0000","last_became_active":"2024-09-11T00:44:17.354293+0000","last_became_peered":"2024-09-11T00:44:17.354293+0000","last_unstale":"2024-09-11T01:12:54.150576+0000","last_undegraded":"2024-09-11T01:12:54.150576+0000","last_fullsized":"2024-09-11T01:12:54.150576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-11T01:12:54.150422+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-11T01:12:54.150422+0000","last_clean_scrub_stamp":"2024-09-11T01:12:54.150422+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:37.421408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'18","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.179547+0000","last_change":"2024-09-11T01:12:53.179475+0000","last_active":"2024-09-11T01:12:53.179547+0000","last_peered":"2024-09-11T01:12:53.179547+0000","last_clean":"2024-09-11T01:12:53.179547+0000","last_became_active":"2024-09-11T00:44:17.360805+0000","last_became_peered":"2024-09-11T00:44:17.360805+0000","last_unstale":"2024-09-11T01:12:53.179547+0000","last_undegraded":"2024-09-11T01:12:53.179547+0000","last_fullsized":"2024-09-11T01:12:53.179547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-09-11T01:12:53.179379+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-09-11T01:12:53.179379+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.179379+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:31.830733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:55.110073+0000","last_change":"2024-09-11T01:12:55.110016+0000","last_active":"2024-09-11T01:12:55.110073+0000","last_peered":"2024-09-11T01:12:55.110073+0000","last_clean":"2024-09-11T01:12:55.110073+0000","last_became_active":"2024-09-11T00:44:17.354799+0000","last_became_peered":"2024-09-11T00:44:17.354799+0000","last_unstale":"2024-09-11T01:12:55.110073+0000","last_undegraded":"2024-09-11T01:12:55.110073+0000","last_fullsized":"2024-09-11T01:12:55.110073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-11T01:12:55.109941+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-11T01:12:55.109941+0000","last_clean_scrub_stamp":"2024-09-11T01:12:55.109941+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:25.703308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'27","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.670034+0000","last_change":"2024-09-11T01:12:46.669985+0000","last_active":"2024-09-11T01:12:46.670034+0000","last_peered":"2024-09-11T01:12:46.670034+0000","last_clean":"2024-09-11T01:12:46.670034+0000","last_became_active":"2024-09-11T00:44:17.350814+0000","last_became_peered":"2024-09-11T00:44:17.350814+0000","last_unstale":"2024-09-11T01:12:46.670034+0000","last_undegraded":"2024-09-11T01:12:46.670034+0000","last_fullsized":"2024-09-11T01:12:46.670034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-11T01:12:46.669891+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-11T01:12:46.669891+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.669891+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:41.909794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'14","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:58.017586+0000","last_change":"2024-09-11T01:12:58.017586+0000","last_active":"2024-09-11T01:12:58.017586+0000","last_peered":"2024-09-11T01:12:58.017586+0000","last_clean":"2024-09-11T01:12:58.017586+0000","last_became_active":"2024-09-11T00:44:17.349613+0000","last_became_peered":"2024-09-11T00:44:17.349613+0000","last_unstale":"2024-09-11T01:12:58.017586+0000","last_undegraded":"2024-09-11T01:12:58.017586+0000","last_fullsized":"2024-09-11T01:12:58.017586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:58.017484+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:58.017484+0000","last_clean_scrub_stamp":"2024-09-11T01:12:58.017484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:40.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'14","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:53.381877+0000","last_change":"2024-09-11T01:12:53.381877+0000","last_active":"2024-09-11T01:12:53.381877+0000","last_peered":"2024-09-11T01:12:53.381877+0000","last_clean":"2024-09-11T01:12:53.381877+0000","last_became_active":"2024-09-11T00:44:57.515898+0000","last_became_peered":"2024-09-11T00:44:57.515898+0000","last_unstale":"2024-09-11T01:12:53.381877+0000","last_undegraded":"2024-09-11T01:12:53.381877+0000","last_fullsized":"2024-09-11T01:12:53.381877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-09-11T01:12:53.381780+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-09-11T01:12:53.381780+0000","last_clean_scrub_stamp":"2024-09-11T01:12:53.381780+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:19.257767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'16","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:47.728355+0000","last_change":"2024-09-11T01:12:47.728355+0000","last_active":"2024-09-11T01:12:47.728355+0000","last_peered":"2024-09-11T01:12:47.728355+0000","last_clean":"2024-09-11T01:12:47.728355+0000","last_became_active":"2024-09-11T00:44:17.333843+0000","last_became_peered":"2024-09-11T00:44:17.333843+0000","last_unstale":"2024-09-11T01:12:47.728355+0000","last_undegraded":"2024-09-11T01:12:47.728355+0000","last_fullsized":"2024-09-11T01:12:47.728355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:47.728294+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:47.728294+0000","last_clean_scrub_stamp":"2024-09-11T01:12:47.728294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:07.968503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'19","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:56.154564+0000","last_change":"2024-09-11T01:12:56.154564+0000","last_active":"2024-09-11T01:12:56.154564+0000","last_peered":"2024-09-11T01:12:56.154564+0000","last_clean":"2024-09-11T01:12:56.154564+0000","last_became_active":"2024-09-11T00:44:17.357420+0000","last_became_peered":"2024-09-11T00:44:17.357420+0000","last_unstale":"2024-09-11T01:12:56.154564+0000","last_undegraded":"2024-09-11T01:12:56.154564+0000","last_fullsized":"2024-09-11T01:12:56.154564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:56.154485+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:56.154485+0000","last_clean_scrub_stamp":"2024-09-11T01:12:56.154485+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:10.154796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:46.679483+0000","last_change":"2024-09-11T01:12:46.679483+0000","last_active":"2024-09-11T01:12:46.679483+0000","last_peered":"2024-09-11T01:12:46.679483+0000","last_clean":"2024-09-11T01:12:46.679483+0000","last_became_active":"2024-09-11T00:44:17.345578+0000","last_became_peered":"2024-09-11T00:44:17.345578+0000","last_unstale":"2024-09-11T01:12:46.679483+0000","last_undegraded":"2024-09-11T01:12:46.679483+0000","last_fullsized":"2024-09-11T01:12:46.679483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-09-11T01:12:46.679424+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-09-11T01:12:46.679424+0000","last_clean_scrub_stamp":"2024-09-11T01:12:46.679424+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:03.216320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'19","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.013345+0000","last_change":"2024-09-11T01:12:59.013345+0000","last_active":"2024-09-11T01:12:59.013345+0000","last_peered":"2024-09-11T01:12:59.013345+0000","last_clean":"2024-09-11T01:12:59.013345+0000","last_became_active":"2024-09-11T00:44:17.346926+0000","last_became_peered":"2024-09-11T00:44:17.346926+0000","last_unstale":"2024-09-11T01:12:59.013345+0000","last_undegraded":"2024-09-11T01:12:59.013345+0000","last_fullsized":"2024-09-11T01:12:59.013345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-11T01:12:59.013265+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-11T01:12:59.013265+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.013265+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:50.078901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'10","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:59.980037+0000","last_change":"2024-09-11T01:12:59.980037+0000","last_active":"2024-09-11T01:12:59.980037+0000","last_peered":"2024-09-11T01:12:59.980037+0000","last_clean":"2024-09-11T01:12:59.980037+0000","last_became_active":"2024-09-11T00:44:17.357559+0000","last_became_peered":"2024-09-11T00:44:17.357559+0000","last_unstale":"2024-09-11T01:12:59.980037+0000","last_undegraded":"2024-09-11T01:12:59.980037+0000","last_fullsized":"2024-09-11T01:12:59.980037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-09-11T01:12:59.979925+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-09-11T01:12:59.979925+0000","last_clean_scrub_stamp":"2024-09-11T01:12:59.979925+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:05.881456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'16","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T01:12:57.174352+0000","last_change":"2024-09-11T01:12:57.174352+0000","last_active":"2024-09-11T01:12:57.174352+0000","last_peered":"2024-09-11T01:12:57.174352+0000","last_clean":"2024-09-11T01:12:57.174352+0000","last_became_active":"2024-09-11T00:44:17.354879+0000","last_became_peered":"2024-09-11T00:44:17.354879+0000","last_unstale":"2024-09-11T01:12:57.174352+0000","last_undegraded":"2024-09-11T01:12:57.174352+0000","last_fullsized":"2024-09-11T01:12:57.174352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-09-11T01:12:57.174277+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-09-11T01:12:57.174277+0000","last_clean_scrub_stamp":"2024-09-11T01:12:57.174277+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:31.414776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613649,"num_write_kb":15550082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117669,"ondisk_log_size":117669,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15868047,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":132,"num_write":3778,"num_write_kb":16856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21004288,"data_stored":31736094,"data_compressed":2432218,"data_compressed_allocated":3383296,"data_compressed_original":14180352,"omap_allocated":0,"internal_metadata":0},"log_size":3318,"ondisk_log_size":3318,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65104,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509795,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":769756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":769342,"kb_avail":93602084,"statfs":{"total":96636764160,"available":95848534016,"internally_reserved":0,"allocated":405504,"data_stored":218612,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":1590,"internal_metadata":787806666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509794,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636272,"kb_used_data":2784,"kb_used_omap":1,"kb_used_meta":633470,"kb_avail":93735568,"statfs":{"total":96636764160,"available":95985221632,"internally_reserved":0,"allocated":2850816,"data_stored":4318523,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":1594,"internal_metadata":648673734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509794,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":601872,"kb_used_data":2944,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93769968,"statfs":{"total":96636764160,"available":96020447232,"internally_reserved":0,"allocated":3014656,"data_stored":5003252,"data_compressed":403369,"data_compressed_allocated":548864,"data_compressed_original":2736128,"omap_allocated":1595,"internal_metadata":613284293},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509793,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":749228,"kb_used_data":6172,"kb_used_omap":1,"kb_used_meta":743038,"kb_avail":93622612,"statfs":{"total":96636764160,"available":95869554688,"internally_reserved":0,"allocated":6320128,"data_stored":7508501,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":1593,"internal_metadata":760871367},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509794,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":578392,"kb_used_data":5960,"kb_used_omap":1,"kb_used_meta":572414,"kb_avail":93793448,"statfs":{"total":96636764160,"available":96044490752,"internally_reserved":0,"allocated":6103040,"data_stored":8513499,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":1595,"internal_metadata":586152389},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509793,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710528,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":710142,"kb_avail":93661312,"statfs":{"total":96636764160,"available":95909183488,"internally_reserved":0,"allocated":376832,"data_stored":714657,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":727185861},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509794,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454788,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":454462,"kb_avail":93917052,"statfs":{"total":96636764160,"available":96171061248,"internally_reserved":0,"allocated":315392,"data_stored":124275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":465369541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575203,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603036,"kb_used_data":4108,"kb_used_omap":1,"kb_used_meta":598910,"kb_avail":93768804,"statfs":{"total":96636764160,"available":96019255296,"internally_reserved":0,"allocated":4206592,"data_stored":7509263,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":1594,"internal_metadata":613284294},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32552,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8389280,"data_compressed":570398,"data_compressed_allocated":798720,"data_compressed_original":3399680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6012928,"data_stored":7384282,"data_compressed":332721,"data_compressed_allocated":491520,"data_compressed_original":1867776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3899392,"data_stored":7385044,"data_compressed":787465,"data_compressed_allocated":1085440,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":4288665,"data_compressed":370817,"data_compressed_allocated":503808,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2543616,"data_stored":4194304,"data_compressed":368140,"data_compressed_allocated":499712,"data_compressed_original":2150400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":94393,"data_compressed":2677,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:13:27.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T01:13:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 -- 172.21.15.81:0/3122201235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 msgr2=0x7feaf0070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 --2- 172.21.15.81:0/3122201235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf0070c40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feadc005fd0 tx=0x7feadc02a5d0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 -- 172.21.15.81:0/3122201235 shutdown_connections 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 --2- 172.21.15.81:0/3122201235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf0070c40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 -- 172.21.15.81:0/3122201235 >> 172.21.15.81:0/3122201235 conn(0x7feaf006ff90 msgr2=0x7feaf00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 -- 172.21.15.81:0/3122201235 shutdown_connections 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.397+0000 7feaf5000640 1 -- 172.21.15.81:0/3122201235 wait complete. 2024-09-11T01:13:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.398+0000 7feaf5000640 1 Processor -- start 2024-09-11T01:13:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.398+0000 7feaf5000640 1 -- start start 2024-09-11T01:13:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 0x7feaf00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaf00725a0 0x7feaf0151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feaf00c6bf0 con 0x7feaf00c7a70 2024-09-11T01:13:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feaf00b1a10 con 0x7feaf006f760 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.399+0000 7feaf5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feaf00c6e40 con 0x7feaf00725a0 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46394/0 (socket says 172.21.15.81:46394) 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 -- 172.21.15.81:0/1757172292 learned_addr learned my addr 172.21.15.81:0/1757172292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaed400640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaf00725a0 0x7feaf0151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaede00640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 0x7feaf00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 -- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaf00725a0 msgr2=0x7feaf0151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaf00725a0 0x7feaf0151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 -- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 msgr2=0x7feaf00afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 0x7feaf00afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 -- 172.21.15.81:0/1757172292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf00af370 con 0x7feaf00c7a70 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaede00640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 0x7feaf00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:13:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.400+0000 7feaee800640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feae800c7a0 tx=0x7feae800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.401+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8003b70 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.401+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feae8003d10 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.401+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae800aab0 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.401+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf00c2c30 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.401+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf00aedb0 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.402+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf0074250 con 0x7feaf00c7a70 2024-09-11T01:13:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.403+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feae800ac50 con 0x7feaf00c7a70 2024-09-11T01:13:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.404+0000 7feae6000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 0x7fead007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.404+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7feae8099fa0 con 0x7feaf00c7a70 2024-09-11T01:13:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.404+0000 7feaede00640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 0x7fead007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.405+0000 7feaede00640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 0x7fead007a430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feae0003eb0 tx=0x7feae0009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.408+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feaf0074250 con 0x7feaf00c7a70 2024-09-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.591+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7feaf00ca350 con 0x7feaf00c7a70 2024-09-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.595+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7feaf00ca350 con 0x7feaf00c7a70 2024-09-11T01:13:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.596+0000 7feae6000640 1 -- 172.21.15.81:0/1757172292 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7feae8061a20 con 0x7feaf00c7a70 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 msgr2=0x7fead007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 0x7fead007a430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feae0003eb0 tx=0x7feae0009040 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 msgr2=0x7feaf00c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feae800c7a0 tx=0x7feae800cc60 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 shutdown_connections 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fead0077f70 0x7fead007a430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf00c7a70 0x7feaf00c2210 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaf00725a0 0x7feaf0151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 --2- 172.21.15.81:0/1757172292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaf006f760 0x7feaf00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 >> 172.21.15.81:0/1757172292 conn(0x7feaf006ff90 msgr2=0x7feaf0075990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 shutdown_connections 2024-09-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.598+0000 7feaf5000640 1 -- 172.21.15.81:0/1757172292 wait complete. 2024-09-11T01:13:27.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T01:13:27.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:13:27.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 -- 172.21.15.81:0/3607431849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d54074860 msgr2=0x7f8d540c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 --2- 172.21.15.81:0/3607431849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d54074860 0x7f8d540c7980 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8d54070080 tx=0x7f8d3c02a5f0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 -- 172.21.15.81:0/3607431849 shutdown_connections 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 --2- 172.21.15.81:0/3607431849 >> v2:172.21.15.167:3300/0 conn(0x7f8d540c8680 0x7f8d540c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 --2- 172.21.15.81:0/3607431849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d54074860 0x7f8d540c7980 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 --2- 172.21.15.81:0/3607431849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 0x7f8d540c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 -- 172.21.15.81:0/3607431849 >> 172.21.15.81:0/3607431849 conn(0x7f8d540700f0 msgr2=0x7f8d54070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 -- 172.21.15.81:0/3607431849 shutdown_connections 2024-09-11T01:13:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.773+0000 7f8d5b000640 1 -- 172.21.15.81:0/3607431849 wait complete. 2024-09-11T01:13:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.775+0000 7f8d5b000640 1 Processor -- start 2024-09-11T01:13:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.775+0000 7f8d5b000640 1 -- start start 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d54074860 0x7f8d5414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 0x7f8d541f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d54070cf0 con 0x7f8d541efb10 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5415c140 con 0x7f8d54074860 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d5b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8d541529f0 con 0x7f8d54152610 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46412/0 (socket says 172.21.15.81:46412) 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 -- 172.21.15.81:0/2204687300 learned_addr learned my addr 172.21.15.81:0/2204687300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d53e00640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d54074860 0x7f8d5414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d4be00640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 0x7f8d541f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 -- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 msgr2=0x7f8d541f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 0x7f8d541f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 -- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d54074860 msgr2=0x7f8d5414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d54074860 0x7f8d5414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.776+0000 7f8d59000640 1 -- 172.21.15.81:0/2204687300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5414a230 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d59000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00cae0 tx=0x7f8d4c00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00ae30 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f8d4c003970 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003dc0 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d54155ae0 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.777+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5414a780 con 0x7f8d541efb10 2024-09-11T01:13:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.778+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d540c2ea0 con 0x7f8d541efb10 2024-09-11T01:13:27.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.779+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8d4c004030 con 0x7f8d541efb10 2024-09-11T01:13:27.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.780+0000 7f8d50c00640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 0x7f8d3007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:27.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.780+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f8d4c09a890 con 0x7f8d541efb10 2024-09-11T01:13:27.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.780+0000 7f8d53e00640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 0x7f8d3007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:27.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.781+0000 7f8d53e00640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 0x7f8d3007a460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8d44004630 tx=0x7f8d4400b2e0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:27.784+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8d4c014070 con 0x7f8d541efb10 2024-09-11T01:13:28.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.001+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d540c18e0 con 0x7f8d541efb10 2024-09-11T01:13:28.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.002+0000 7f8d50c00640 1 -- 172.21.15.81:0/2204687300 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f8d4c062930 con 0x7f8d541efb10 2024-09-11T01:13:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:13:28.004 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:13:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:13:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 msgr2=0x7f8d3007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 0x7f8d3007a460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8d44004630 tx=0x7f8d4400b2e0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 msgr2=0x7f8d5414aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00cae0 tx=0x7f8d4c00a250 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 shutdown_connections 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f8d30077fa0 0x7f8d3007a460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d541efb10 0x7f8d5414aca0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d54152610 0x7f8d541f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 --2- 172.21.15.81:0/2204687300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d54074860 0x7f8d5414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 >> 172.21.15.81:0/2204687300 conn(0x7f8d540700f0 msgr2=0x7f8d5414d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 shutdown_connections 2024-09-11T01:13:28.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.005+0000 7f8d5b000640 1 -- 172.21.15.81:0/2204687300 wait complete. 2024-09-11T01:13:28.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 -- 172.21.15.81:0/3506475760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 msgr2=0x7f8814072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 --2- 172.21.15.81:0/3506475760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814072650 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f880c005fd0 tx=0x7f880c02a5d0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 -- 172.21.15.81:0/3506475760 shutdown_connections 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 --2- 172.21.15.81:0/3506475760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814072650 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 -- 172.21.15.81:0/3506475760 >> 172.21.15.81:0/3506475760 conn(0x7f88140700f0 msgr2=0x7f8814070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 -- 172.21.15.81:0/3506475760 shutdown_connections 2024-09-11T01:13:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.176+0000 7f8818e00640 1 -- 172.21.15.81:0/3506475760 wait complete. 2024-09-11T01:13:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.178+0000 7f8818e00640 1 Processor -- start 2024-09-11T01:13:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.178+0000 7f8818e00640 1 -- start start 2024-09-11T01:13:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c7bf0 0x7f88141452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140c7fd0 0x7f8814149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8814073250 con 0x7f8814154ad0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f881415b0d0 con 0x7f88140c7bf0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8818e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f881415a610 con 0x7f88140c7fd0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8812800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8812800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46430/0 (socket says 172.21.15.81:46430) 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8812800640 1 -- 172.21.15.81:0/1538517299 learned_addr learned my addr 172.21.15.81:0/1538517299 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8811e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c7bf0 0x7f88141452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.179+0000 7f8811400640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140c7fd0 0x7f8814149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 -- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140c7fd0 msgr2=0x7f8814149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140c7fd0 0x7f8814149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 -- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c7bf0 msgr2=0x7f88141452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c7bf0 0x7f88141452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 -- 172.21.15.81:0/1538517299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881414a200 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8812800640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f880c006010 tx=0x7f880c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c03e030 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f880c003d30 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c035040 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8814152ea0 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.180+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8814153460 con 0x7f8814154ad0 2024-09-11T01:13:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.181+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8814074080 con 0x7f8814154ad0 2024-09-11T01:13:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.182+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f880c004990 con 0x7f8814154ad0 2024-09-11T01:13:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.183+0000 7f880a000640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 0x7f87f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.183+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f880c0ba900 con 0x7f8814154ad0 2024-09-11T01:13:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.184+0000 7f8811e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 0x7f87f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.185+0000 7f8811e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 0x7f87f407a430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8804005660 tx=0x7f8804003d90 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.188+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f880c0829a0 con 0x7f8814154ad0 2024-09-11T01:13:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.406+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88140c24e0 con 0x7f8814154ad0 2024-09-11T01:13:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.406+0000 7f880a000640 1 -- 172.21.15.81:0/1538517299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6874 (secure 0 0 0) 0x7f880c0873d0 con 0x7f8814154ad0 2024-09-11T01:13:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:13:28.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-11T00:44:43:428133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1108040963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1108040963},{"type":"v1","addr":"172.21.15.81:6835","nonce":1108040963}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4352,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3089169276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3089169276},{"type":"v1","addr":"172.21.15.81:6837","nonce":3089169276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3463968517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3463968517},{"type":"v1","addr":"172.21.15.81:6834","nonce":3463968517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4364,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3769956525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6837","nonce":3769956525},{"type":"v1","addr":"172.21.15.167:6839","nonce":3769956525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6838/870225324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":870225324},{"type":"v1","addr":"172.21.15.167:6838","nonce":870225324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:44:16.758683+0000","modified":"2024-09-11T00:44:42.883390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6835/1821136348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1821136348},{"type":"v1","addr":"172.21.15.167:6835","nonce":1821136348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-11T01:13:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-11T01:13:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.408+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 msgr2=0x7f87f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.408+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 0x7f87f407a430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8804005660 tx=0x7f8804003d90 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 msgr2=0x7f8814147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f880c006010 tx=0x7f880c003820 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 shutdown_connections 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f87f4077f70 0x7f87f407a430 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8814154ad0 0x7f8814147050 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140c7fd0 0x7f8814149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 --2- 172.21.15.81:0/1538517299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88140c7bf0 0x7f88141452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 >> 172.21.15.81:0/1538517299 conn(0x7f88140700f0 msgr2=0x7f881414aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 shutdown_connections 2024-09-11T01:13:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.409+0000 7f8818e00640 1 -- 172.21.15.81:0/1538517299 wait complete. 2024-09-11T01:13:28.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 -- 172.21.15.81:0/3965125246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9480c8680 msgr2=0x7fb948163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 --2- 172.21.15.81:0/3965125246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9480c8680 0x7fb948163da0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb940005fd0 tx=0x7fb94002abc0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 -- 172.21.15.81:0/3965125246 shutdown_connections 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 --2- 172.21.15.81:0/3965125246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9480c8680 0x7fb948163da0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 -- 172.21.15.81:0/3965125246 >> 172.21.15.81:0/3965125246 conn(0x7fb9480700f0 msgr2=0x7fb948070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 -- 172.21.15.81:0/3965125246 shutdown_connections 2024-09-11T01:13:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.582+0000 7fb94f000640 1 -- 172.21.15.81:0/3965125246 wait complete. 2024-09-11T01:13:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.584+0000 7fb94f000640 1 Processor -- start 2024-09-11T01:13:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.584+0000 7fb94f000640 1 -- start start 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb948074860 0x7fb94814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 0x7fb948149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb948070cf0 con 0x7fb948152610 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb94815c140 con 0x7fb948074860 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb9480c16a0 con 0x7fb94814bec0 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46456/0 (socket says 172.21.15.81:46456) 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 -- 172.21.15.81:0/3679521157 learned_addr learned my addr 172.21.15.81:0/3679521157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb947e00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb948074860 0x7fb94814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94d000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 0x7fb948149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 -- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 msgr2=0x7fb948149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 0x7fb948149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 -- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb948074860 msgr2=0x7fb94814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb948074860 0x7fb94814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb93fe00640 1 -- 172.21.15.81:0/3679521157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9481ee5d0 con 0x7fb948152610 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.585+0000 7fb94d000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 0x7fb948149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:13:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb93fe00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c3f0 tx=0x7fb93000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930017070 con 0x7fb948152610 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb9300052f0 con 0x7fb948152610 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930003870 con 0x7fb948152610 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94814a1b0 con 0x7fb948152610 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.586+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94814a770 con 0x7fb948152610 2024-09-11T01:13:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.587+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94814a970 con 0x7fb948152610 2024-09-11T01:13:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.588+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb930003a10 con 0x7fb948152610 2024-09-11T01:13:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.590+0000 7fb944c00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 0x7fb92407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.590+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7fb930099750 con 0x7fb948152610 2024-09-11T01:13:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.590+0000 7fb947e00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 0x7fb92407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.591+0000 7fb947e00640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 0x7fb92407a430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb938000f60 tx=0x7fb938009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.594+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb94814a970 con 0x7fb948152610 2024-09-11T01:13:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.782+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9481529f0 con 0x7fb948152610 2024-09-11T01:13:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.783+0000 7fb944c00640 1 -- 172.21.15.81:0/3679521157 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18721 (secure 0 0 0) 0x7fb9300617f0 con 0x7fb948152610 2024-09-11T01:13:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-11T01:13:28.785 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"fsid":"62a8ae86-7f85-478f-9a99-4c394aac48f1","created":"2024-09-11T00:43:50.586143+0000","modified":"2024-09-11T00:44:57.502396+0000","last_up_change":"2024-09-11T00:44:04.583756+0000","last_in_change":"2024-09-11T00:43:55.103255+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:44:05.835609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:44:14.745068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:44:15.707183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T00:44:19.352256+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f329a9cd-4ae9-4169-8bed-8c06aafa4763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6802","nonce":1565697795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6806","nonce":1565697795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6814","nonce":1565697795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1565697795},{"type":"v1","addr":"172.21.15.81:6810","nonce":1565697795}]},"public_addr":"172.21.15.81:6802/1565697795","cluster_addr":"172.21.15.81:6806/1565697795","heartbeat_back_addr":"172.21.15.81:6814/1565697795","heartbeat_front_addr":"172.21.15.81:6810/1565697795","state":["exists","up"]},{"osd":1,"uuid":"be080b01-709b-4d1b-b275-b96ff5040a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6817","nonce":1592127640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6819","nonce":1592127640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6823","nonce":1592127640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1592127640},{"type":"v1","addr":"172.21.15.81:6821","nonce":1592127640}]},"public_addr":"172.21.15.81:6817/1592127640","cluster_addr":"172.21.15.81:6819/1592127640","heartbeat_back_addr":"172.21.15.81:6823/1592127640","heartbeat_front_addr":"172.21.15.81:6821/1592127640","state":["exists","up"]},{"osd":2,"uuid":"0caeed21-5fda-4904-b9b3-d768371118a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6825","nonce":2087915132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6827","nonce":2087915132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6831","nonce":2087915132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2087915132},{"type":"v1","addr":"172.21.15.81:6829","nonce":2087915132}]},"public_addr":"172.21.15.81:6825/2087915132","cluster_addr":"172.21.15.81:6827/2087915132","heartbeat_back_addr":"172.21.15.81:6831/2087915132","heartbeat_front_addr":"172.21.15.81:6829/2087915132","state":["exists","up"]},{"osd":3,"uuid":"70834bf0-d46b-4e78-bac3-e78285ecb3ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6803","nonce":3351502338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6805","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6807","nonce":3351502338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6813","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3351502338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":3351502338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3351502338}]},"public_addr":"172.21.15.81:6803/3351502338","cluster_addr":"172.21.15.81:6807/3351502338","heartbeat_back_addr":"172.21.15.81:6815/3351502338","heartbeat_front_addr":"172.21.15.81:6811/3351502338","state":["exists","up"]},{"osd":4,"uuid":"54abce3f-8da0-456b-aaba-f49e981ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6803","nonce":2940055079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6805","nonce":2940055079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6809","nonce":2940055079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2940055079},{"type":"v1","addr":"172.21.15.167:6807","nonce":2940055079}]},"public_addr":"172.21.15.167:6803/2940055079","cluster_addr":"172.21.15.167:6805/2940055079","heartbeat_back_addr":"172.21.15.167:6809/2940055079","heartbeat_front_addr":"172.21.15.167:6807/2940055079","state":["exists","up"]},{"osd":5,"uuid":"da42f801-5ca2-4720-a59f-1031fc65f7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6819","nonce":3209520310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6821","nonce":3209520310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6825","nonce":3209520310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3209520310},{"type":"v1","addr":"172.21.15.167:6823","nonce":3209520310}]},"public_addr":"172.21.15.167:6819/3209520310","cluster_addr":"172.21.15.167:6821/3209520310","heartbeat_back_addr":"172.21.15.167:6825/3209520310","heartbeat_front_addr":"172.21.15.167:6823/3209520310","state":["exists","up"]},{"osd":6,"uuid":"679373c5-4b0b-4ca9-9808-29966ab5f724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6811","nonce":3232528016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6813","nonce":3232528016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6817","nonce":3232528016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3232528016},{"type":"v1","addr":"172.21.15.167:6815","nonce":3232528016}]},"public_addr":"172.21.15.167:6811/3232528016","cluster_addr":"172.21.15.167:6813/3232528016","heartbeat_back_addr":"172.21.15.167:6817/3232528016","heartbeat_front_addr":"172.21.15.167:6815/3232528016","state":["exists","up"]},{"osd":7,"uuid":"a7dfd4fc-5f4e-4806-abfc-b64c9685cc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6827","nonce":2027890560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6829","nonce":2027890560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6833","nonce":2027890560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2027890560},{"type":"v1","addr":"172.21.15.167:6831","nonce":2027890560}]},"public_addr":"172.21.15.167:6827/2027890560","cluster_addr":"172.21.15.167:6829/2027890560","heartbeat_back_addr":"172.21.15.167:6833/2027890560","heartbeat_front_addr":"172.21.15.167:6831/2027890560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.672724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.459791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:02.124089+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.708584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.295924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.449486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.685885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:44:01.942848+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:13:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.785+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 msgr2=0x7fb92407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.785+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 0x7fb92407a430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb938000f60 tx=0x7fb938009040 comp rx=0 tx=0).stop 2024-09-11T01:13:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 msgr2=0x7fb9480c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c3f0 tx=0x7fb93000c8b0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 shutdown_connections 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fb924077f70 0x7fb92407a430 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94814bec0 0x7fb948149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb948152610 0x7fb9480c5250 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 --2- 172.21.15.81:0/3679521157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb948074860 0x7fb94814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 >> 172.21.15.81:0/3679521157 conn(0x7fb9480700f0 msgr2=0x7fb94814fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 shutdown_connections 2024-09-11T01:13:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.786+0000 7fb94f000640 1 -- 172.21.15.81:0/3679521157 wait complete. 2024-09-11T01:13:28.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 -- 172.21.15.81:0/4141265715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3184074860 msgr2=0x7f31840c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 --2- 172.21.15.81:0/4141265715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3184074860 0x7f31840c7980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f318415c630 tx=0x7f316c02a650 comp rx=0 tx=0).stop 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 -- 172.21.15.81:0/4141265715 shutdown_connections 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 --2- 172.21.15.81:0/4141265715 >> v2:172.21.15.167:3300/0 conn(0x7f31840c8680 0x7f31840c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 --2- 172.21.15.81:0/4141265715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3184074860 0x7f31840c7980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 -- 172.21.15.81:0/4141265715 >> 172.21.15.81:0/4141265715 conn(0x7f31840700f0 msgr2=0x7f3184070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 -- 172.21.15.81:0/4141265715 shutdown_connections 2024-09-11T01:13:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.960+0000 7f3189000640 1 -- 172.21.15.81:0/4141265715 wait complete. 2024-09-11T01:13:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.962+0000 7f3189000640 1 Processor -- start 2024-09-11T01:13:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.962+0000 7f3189000640 1 -- start start 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184074860 0x7f31840b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31840b0d70 0x7f3184073e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3184070cf0 con 0x7f3184152610 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f318415c140 con 0x7f3184074860 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3189000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f31840c16a0 con 0x7f31840b0d70 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f317be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f317be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46462/0 (socket says 172.21.15.81:46462) 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f317be00640 1 -- 172.21.15.81:0/1692505943 learned_addr learned my addr 172.21.15.81:0/1692505943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3181e00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184074860 0x7f31840b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.963+0000 7f3182800640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31840b0d70 0x7f3184073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 -- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31840b0d70 msgr2=0x7f3184073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31840b0d70 0x7f3184073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 -- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184074860 msgr2=0x7f31840b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184074860 0x7f31840b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 -- 172.21.15.81:0/1692505943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3184154050 con 0x7f3184152610 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317be00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f316c034040 tx=0x7f316c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c03e030 con 0x7f3184152610 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f316c003e20 con 0x7f3184152610 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c035040 con 0x7f3184152610 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.964+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318414d410 con 0x7f3184152610 2024-09-11T01:13:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.965+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841f11a0 con 0x7f3184152610 2024-09-11T01:13:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.965+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31841529f0 con 0x7f3184152610 2024-09-11T01:13:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.966+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f316c004990 con 0x7f3184152610 2024-09-11T01:13:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.967+0000 7f317a000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 0x7f316007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.967+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6590+0+0 (secure 0 0 0) 0x7f316c0baa40 con 0x7f3184152610 2024-09-11T01:13:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.968+0000 7f3181e00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 0x7f316007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.968+0000 7f3181e00640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 0x7f316007a430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f31740017c0 tx=0x7f3174009040 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:28.971+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f316c082ae0 con 0x7f3184152610 2024-09-11T01:13:29.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.189+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f31840aedc0 con 0x7f3184152610 2024-09-11T01:13:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.209+0000 7f317a000640 1 -- 172.21.15.81:0/1692505943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f316c087510 con 0x7f3184152610 2024-09-11T01:13:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T01:13:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.212+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 msgr2=0x7f316007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.212+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 0x7f316007a430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f31740017c0 tx=0x7f3174009040 comp rx=0 tx=0).stop 2024-09-11T01:13:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.212+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 msgr2=0x7f3184073920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.212+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f316c034040 tx=0x7f316c003910 comp rx=0 tx=0).stop 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 shutdown_connections 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f3160077f70 0x7f316007a430 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f31740017c0 tx=0x7f3174009040 comp rx=0 tx=0).stop 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31840b0d70 0x7f3184073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3184152610 0x7f3184073920 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 --2- 172.21.15.81:0/1692505943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184074860 0x7f31840b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 >> 172.21.15.81:0/1692505943 conn(0x7f31840700f0 msgr2=0x7f318414e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 shutdown_connections 2024-09-11T01:13:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.213+0000 7f3189000640 1 -- 172.21.15.81:0/1692505943 wait complete. 2024-09-11T01:13:29.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T01:13:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 -- 172.21.15.81:0/1381085844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e80c0eb0 msgr2=0x7f44e80c1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 --2- 172.21.15.81:0/1381085844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e80c0eb0 0x7f44e80c1300 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f44e80721f0 tx=0x7f44e002aac0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 -- 172.21.15.81:0/1381085844 shutdown_connections 2024-09-11T01:13:29.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 --2- 172.21.15.81:0/1381085844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e80c0eb0 0x7f44e80c1300 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 --2- 172.21.15.81:0/1381085844 >> v2:172.21.15.167:3300/0 conn(0x7f44e8154530 0x7f44e8154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 -- 172.21.15.81:0/1381085844 >> 172.21.15.81:0/1381085844 conn(0x7f44e806ff90 msgr2=0x7f44e80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 -- 172.21.15.81:0/1381085844 shutdown_connections 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.387+0000 7f44ee200640 1 -- 172.21.15.81:0/1381085844 wait complete. 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.389+0000 7f44ee200640 1 Processor -- start 2024-09-11T01:13:29.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.389+0000 7f44ee200640 1 -- start start 2024-09-11T01:13:29.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 0x7f44e81f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:29.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44e80c0eb0 0x7f44e8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:29.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44e806e6c0 con 0x7f44e8154530 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44e806e180 con 0x7f44e806ebe0 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44ee200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f44e80ccce0 con 0x7f44e80c0eb0 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46476/0 (socket says 172.21.15.81:46476) 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 -- 172.21.15.81:0/1815444335 learned_addr learned my addr 172.21.15.81:0/1815444335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7400640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 0x7f44e81f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e6a00640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44e80c0eb0 0x7f44e8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 -- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44e80c0eb0 msgr2=0x7f44e8151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44e80c0eb0 0x7f44e8151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 -- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 msgr2=0x7f44e81f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 0x7f44e81f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7e00640 1 -- 172.21.15.81:0/1815444335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e81e59f0 con 0x7f44e8154530 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.390+0000 7f44e7400640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 0x7f44e81f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44e7e00640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f44e0004af0 tx=0x7f44e0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0044070 con 0x7f44e8154530 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f44e0004250 con 0x7f44e8154530 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e81e5c90 con 0x7f44e8154530 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0004680 con 0x7f44e8154530 2024-09-11T01:13:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.391+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81f3eb0 con 0x7f44e8154530 2024-09-11T01:13:29.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.392+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e8070ab0 con 0x7f44e8154530 2024-09-11T01:13:29.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.393+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f44e002c940 con 0x7f44e8154530 2024-09-11T01:13:29.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.394+0000 7f44df400640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 0x7f44c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:29.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.394+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7f44e00ba910 con 0x7f44e8154530 2024-09-11T01:13:29.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.395+0000 7f44e7400640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 0x7f44c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:29.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.395+0000 7f44e7400640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 0x7f44c807a430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d800b2c0 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:29.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.398+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f44e0032030 con 0x7f44e8154530 2024-09-11T01:13:29.404 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-11T01:13:29.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:29.623+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f44e80b11f0 con 0x7f44e8154530 2024-09-11T01:13:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.211+0000 7f44df400640 1 -- 172.21.15.81:0/1815444335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f44e0004820 con 0x7f44e8154530 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 msgr2=0x7f44c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 0x7f44c807a430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44d8005fd0 tx=0x7f44d800b2c0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 msgr2=0x7f44e806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f44e0004af0 tx=0x7f44e0003f10 comp rx=0 tx=0).stop 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 shutdown_connections 2024-09-11T01:13:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f44c8077f70 0x7f44c807a430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44e8154530 0x7f44e806c9e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44e80c0eb0 0x7f44e8151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 --2- 172.21.15.81:0/1815444335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44e806ebe0 0x7f44e81f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 >> 172.21.15.81:0/1815444335 conn(0x7f44e806ff90 msgr2=0x7f44e8153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 shutdown_connections 2024-09-11T01:13:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.214+0000 7f44ee200640 1 -- 172.21.15.81:0/1815444335 wait complete. 2024-09-11T01:13:30.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T01:13:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 -- 172.21.15.81:0/3711123237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd18152880 msgr2=0x7fdd180725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 --2- 172.21.15.81:0/3711123237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd18152880 0x7fdd180725c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdd180b2410 tx=0x7fdd0802ab50 comp rx=0 tx=0).stop 2024-09-11T01:13:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 -- 172.21.15.81:0/3711123237 shutdown_connections 2024-09-11T01:13:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 --2- 172.21.15.81:0/3711123237 >> v2:172.21.15.167:3300/0 conn(0x7fdd18070b80 0x7fdd1815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 --2- 172.21.15.81:0/3711123237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd18152880 0x7fdd180725c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 -- 172.21.15.81:0/3711123237 >> 172.21.15.81:0/3711123237 conn(0x7fdd1806ffb0 msgr2=0x7fdd180703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 -- 172.21.15.81:0/3711123237 shutdown_connections 2024-09-11T01:13:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.395+0000 7fdd1d600640 1 -- 172.21.15.81:0/3711123237 wait complete. 2024-09-11T01:13:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.397+0000 7fdd1d600640 1 Processor -- start 2024-09-11T01:13:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.397+0000 7fdd1d600640 1 -- start start 2024-09-11T01:13:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd18070b80 0x7fdd180c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd18152880 0x7fdd180b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1806ee60 con 0x7fdd1815c650 2024-09-11T01:13:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18152c60 con 0x7fdd18152880 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd1d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1806efe0 con 0x7fdd18070b80 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46492/0 (socket says 172.21.15.81:46492) 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 -- 172.21.15.81:0/4100882892 learned_addr learned my addr 172.21.15.81:0/4100882892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd16000640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd18152880 0x7fdd180b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd16a00640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd18070b80 0x7fdd180c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 -- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd18070b80 msgr2=0x7fdd180c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd18070b80 0x7fdd180c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 -- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd18152880 msgr2=0x7fdd180b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd18152880 0x7fdd180b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.398+0000 7fdd17400640 1 -- 172.21.15.81:0/4100882892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd181f0f80 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd17400640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c3f0 tx=0x7fdd1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10017070 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fdd100052d0 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10003850 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd180c2e60 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.399+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd181f1500 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.400+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd18158200 con 0x7fdd1815c650 2024-09-11T01:13:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.401+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdd100039f0 con 0x7fdd1815c650 2024-09-11T01:13:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.402+0000 7fdd0ea00640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 0x7fdcf807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.402+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6676+0+0 (secure 0 0 0) 0x7fdd100997e0 con 0x7fdd1815c650 2024-09-11T01:13:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.403+0000 7fdd16a00640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 0x7fdcf807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.403+0000 7fdd16a00640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 0x7fdcf807a430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd08035000 tx=0x7fdd08004a40 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.406+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdd18158200 con 0x7fdd1815c650 2024-09-11T01:13:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:30.590+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdd18073ff0 con 0x7fdd1815c650 2024-09-11T01:13:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.219+0000 7fdd0ea00640 1 -- 172.21.15.81:0/4100882892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fdd18073ff0 con 0x7fdd1815c650 2024-09-11T01:13:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-11T01:13:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.223+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 msgr2=0x7fdcf807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.223+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 0x7fdcf807a430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd08035000 tx=0x7fdd08004a40 comp rx=0 tx=0).stop 2024-09-11T01:13:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.223+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 msgr2=0x7fdd180b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.223+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c3f0 tx=0x7fdd1000c8b0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 shutdown_connections 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7fdcf8077f70 0x7fdcf807a430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1815c650 0x7fdd180b0a90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd18152880 0x7fdd180b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 --2- 172.21.15.81:0/4100882892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd18070b80 0x7fdd180c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 >> 172.21.15.81:0/4100882892 conn(0x7fdd1806ffb0 msgr2=0x7fdd180b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.224+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 shutdown_connections 2024-09-11T01:13:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.225+0000 7fdd1d600640 1 -- 172.21.15.81:0/4100882892 wait complete. 2024-09-11T01:13:31.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T01:13:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 -- 172.21.15.81:0/4078140187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a00c7dd0 msgr2=0x7f13a00725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 --2- 172.21.15.81:0/4078140187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a00c7dd0 0x7f13a00725c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1398005fd0 tx=0x7f139802ab20 comp rx=0 tx=0).stop 2024-09-11T01:13:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 -- 172.21.15.81:0/4078140187 shutdown_connections 2024-09-11T01:13:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 --2- 172.21.15.81:0/4078140187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a00c7dd0 0x7f13a00725c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 -- 172.21.15.81:0/4078140187 >> 172.21.15.81:0/4078140187 conn(0x7f13a006ffb0 msgr2=0x7f13a00703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.412+0000 7f13a6a00640 1 -- 172.21.15.81:0/4078140187 shutdown_connections 2024-09-11T01:13:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.413+0000 7f13a6a00640 1 -- 172.21.15.81:0/4078140187 wait complete. 2024-09-11T01:13:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.414+0000 7f13a6a00640 1 Processor -- start 2024-09-11T01:13:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.414+0000 7f13a6a00640 1 -- start start 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a0070b80 0x7f13a0153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 0x7f13a0153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0152c60 con 0x7f13a0152880 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a015bc80 con 0x7f13a0070b80 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a6a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f13a006ee60 con 0x7f13a00c7dd0 2024-09-11T01:13:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46514/0 (socket says 172.21.15.81:46514) 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f13a4a00640 1 -- 172.21.15.81:0/1477108166 learned_addr learned my addr 172.21.15.81:0/1477108166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f139fe00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a0070b80 0x7f13a0153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.415+0000 7f1397e00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 0x7f13a0153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 -- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 msgr2=0x7f13a0153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 0x7f13a0153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 -- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a0070b80 msgr2=0x7f13a0153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a0070b80 0x7f13a0153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 -- 172.21.15.81:0/1477108166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a00c5b30 con 0x7f13a0152880 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f1397e00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 0x7f13a0153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a4a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1398009d90 tx=0x7f139802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398044070 con 0x7f13a0152880 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f1398004360 con 0x7f13a0152880 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398004790 con 0x7f13a0152880 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a00b1d40 con 0x7f13a0152880 2024-09-11T01:13:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.416+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a0154ed0 con 0x7f13a0152880 2024-09-11T01:13:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.417+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a00742d0 con 0x7f13a0152880 2024-09-11T01:13:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.419+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1398036400 con 0x7f13a0152880 2024-09-11T01:13:31.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.419+0000 7f139cc00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 0x7f137c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:31.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.420+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6238+0+0 (secure 0 0 0) 0x7f13980ba850 con 0x7f13a0152880 2024-09-11T01:13:31.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.420+0000 7f139fe00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 0x7f137c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:31.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.421+0000 7f139fe00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 0x7f137c07a460 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390009060 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:31.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.424+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f13a00742d0 con 0x7f13a0152880 2024-09-11T01:13:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:31.610+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13a00725c0 con 0x7f13a0152880 2024-09-11T01:13:32.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.613+0000 7f139cc00640 1 -- 172.21.15.81:0/1477108166 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f1398032030 con 0x7f13a0152880 2024-09-11T01:13:32.614 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-11T01:13:32.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.620+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 msgr2=0x7f137c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.620+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 0x7f137c07a460 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1390006fd0 tx=0x7f1390009060 comp rx=0 tx=0).stop 2024-09-11T01:13:32.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.620+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 msgr2=0x7f13a0154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.620+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1398009d90 tx=0x7f139802c890 comp rx=0 tx=0).stop 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 shutdown_connections 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7f137c077fa0 0x7f137c07a460 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a0152880 0x7f13a0154340 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13a00c7dd0 0x7f13a0153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 --2- 172.21.15.81:0/1477108166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a0070b80 0x7f13a0153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 >> 172.21.15.81:0/1477108166 conn(0x7f13a006ffb0 msgr2=0x7f13a00c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 shutdown_connections 2024-09-11T01:13:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.621+0000 7f13a6a00640 1 -- 172.21.15.81:0/1477108166 wait complete. 2024-09-11T01:13:32.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T01:13:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 -- 172.21.15.81:0/1043559392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe1c0051c0 msgr2=0x7efe1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 --2- 172.21.15.81:0/1043559392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe1c0051c0 0x7efe1c00b9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efe340c8280 tx=0x7efe1c005830 comp rx=0 tx=0).stop 2024-09-11T01:13:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 -- 172.21.15.81:0/1043559392 shutdown_connections 2024-09-11T01:13:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 --2- 172.21.15.81:0/1043559392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe1c0051c0 0x7efe1c00b9c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 -- 172.21.15.81:0/1043559392 >> 172.21.15.81:0/1043559392 conn(0x7efe3406ffb0 msgr2=0x7efe340703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 -- 172.21.15.81:0/1043559392 shutdown_connections 2024-09-11T01:13:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.806+0000 7efe3bc00640 1 -- 172.21.15.81:0/1043559392 wait complete. 2024-09-11T01:13:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.808+0000 7efe3bc00640 1 Processor -- start 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.808+0000 7efe3bc00640 1 -- start start 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 0x7efe341545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe341e3a90 0x7efe3414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efe34072950 con 0x7efe341e1900 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe340727d0 con 0x7efe341e3a90 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe3bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efe3415bc80 con 0x7efe1c0051c0 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46536/0 (socket says 172.21.15.81:46536) 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 -- 172.21.15.81:0/613812018 learned_addr learned my addr 172.21.15.81:0/613812018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe39c00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe341e3a90 0x7efe3414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe39200640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 0x7efe341545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 -- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 msgr2=0x7efe341545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 0x7efe341545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 -- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe341e3a90 msgr2=0x7efe3414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe341e3a90 0x7efe3414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe33e00640 1 -- 172.21.15.81:0/613812018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe341e3f00 con 0x7efe341e1900 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.809+0000 7efe39200640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 0x7efe341545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe33e00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efe20009460 tx=0x7efe20011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20004460 con 0x7efe341e1900 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7efe20016070 con 0x7efe341e1900 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2000fb80 con 0x7efe341e1900 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe341e1e40 con 0x7efe341e1900 2024-09-11T01:13:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.810+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe34155210 con 0x7efe341e1900 2024-09-11T01:13:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.811+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3415c110 con 0x7efe341e1900 2024-09-11T01:13:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.812+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efe2000fd20 con 0x7efe341e1900 2024-09-11T01:13:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.813+0000 7efe30c00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 0x7efe1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.813+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7efe2009a890 con 0x7efe341e1900 2024-09-11T01:13:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.814+0000 7efe39200640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 0x7efe1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.814+0000 7efe39200640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 0x7efe1407a430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe34074920 tx=0x7efe28006b70 comp rx=0 tx=0).ready entity=mgr.4124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:32.817+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efe20063290 con 0x7efe341e1900 2024-09-11T01:13:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.001+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7efe340c79a0 con 0x7efe341e1900 2024-09-11T01:13:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.614+0000 7efe30c00640 1 -- 172.21.15.81:0/613812018 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7efe20062b90 con 0x7efe341e1900 2024-09-11T01:13:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-11T01:13:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.624+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 msgr2=0x7efe1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.624+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 0x7efe1407a430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe34074920 tx=0x7efe28006b70 comp rx=0 tx=0).stop 2024-09-11T01:13:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.624+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 msgr2=0x7efe341e3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.624+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efe20009460 tx=0x7efe20011c30 comp rx=0 tx=0).stop 2024-09-11T01:13:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 shutdown_connections 2024-09-11T01:13:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:6800/1151185883,v1:172.21.15.167:6801/1151185883] conn(0x7efe14077f70 0x7efe1407a430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe341e3a90 0x7efe3414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe341e1900 0x7efe341e3550 secure :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efe20009460 tx=0x7efe20011c30 comp rx=0 tx=0).stop 2024-09-11T01:13:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 --2- 172.21.15.81:0/613812018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe1c0051c0 0x7efe341545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.625+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 >> 172.21.15.81:0/613812018 conn(0x7efe3406ffb0 msgr2=0x7efe34156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.626+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 shutdown_connections 2024-09-11T01:13:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-11T01:13:33.627+0000 7efe3bc00640 1 -- 172.21.15.81:0/613812018 wait complete. 2024-09-11T01:13:33.659 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T01:13:33.659 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T01:13:33.659 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.692 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T01:13:33.692 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T01:13:33.692 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.775 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T01:13:33.775 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-11T01:13:33.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.805 INFO:tasks.ceph.mds.e:Stopped 2024-09-11T01:13:33.805 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T01:13:33.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.821 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T01:13:33.822 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T01:13:33.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.881 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T01:13:33.881 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-11T01:13:33.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:33.939 INFO:tasks.ceph.mds.f:Stopped 2024-09-11T01:13:33.939 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T01:13:33.939 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T01:13:33.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:40.041 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T01:13:40.041 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T01:13:40.042 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:41.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-11T01:13:46.144 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T01:13:46.144 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T01:13:46.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:47.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-11T01:13:47.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-11T01:13:48.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:13:48.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:13:52.246 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T01:13:52.246 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T01:13:52.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:53.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-11T01:13:53.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-11T01:13:58.348 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T01:13:58.349 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T01:13:58.349 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:13:59.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2024-09-11T01:14:04.450 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T01:14:04.451 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T01:14:04.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:04.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-11T01:14:04.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-11T01:14:10.553 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T01:14:10.553 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T01:14:10.553 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:10.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T01:14:10.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-11T01:14:16.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-11T01:14:16.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-11T01:14:16.655 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T01:14:16.656 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T01:14:16.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:16.757 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T01:14:16.758 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T01:14:16.758 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T01:14:16.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:16.830 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T01:14:16.830 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T01:14:16.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:16.901 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T01:14:16.901 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T01:14:16.901 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T01:14:16.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:16.925 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T01:14:16.925 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T01:14:16.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:16.943 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T01:14:16.943 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T01:14:16.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:14:17.004 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T01:14:17.004 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T01:14:17.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T01:14:17.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:14:17.140 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T01:14:17.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:14:17.343 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T01:14:17.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:14:17.499 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T01:14:17.679 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:14:17.679 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T01:14:17.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T01:14:17.886 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T01:14:18.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:18.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:18.206 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T01:14:18.207 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T01:14:18.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T01:14:18.413 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T01:14:18.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T01:14:18.625 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T01:14:18.791 INFO:tasks.ceph:Archiving mon data... 2024-09-11T01:14:18.792 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/data/mon.a.tgz 2024-09-11T01:14:18.793 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-11T01:14:18.829 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.snrZkkqrAK 2024-09-11T01:14:18.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.snrZkkqrAK 2024-09-11T01:14:19.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.snrZkkqrAK 2024-09-11T01:14:19.139 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.snrZkkqrAK is 352KB 2024-09-11T01:14:19.228 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.snrZkkqrAK 2024-09-11T01:14:19.263 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/data/mon.b.tgz 2024-09-11T01:14:19.263 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T01:14:19.312 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.HxrdpPAR7p 2024-09-11T01:14:19.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HxrdpPAR7p 2024-09-11T01:14:19.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.HxrdpPAR7p 2024-09-11T01:14:19.568 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.HxrdpPAR7p is 371KB 2024-09-11T01:14:19.657 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.HxrdpPAR7p 2024-09-11T01:14:19.692 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/data/mon.c.tgz 2024-09-11T01:14:19.692 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T01:14:19.766 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.KLz7hT8H30 2024-09-11T01:14:19.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.KLz7hT8H30 2024-09-11T01:14:19.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.KLz7hT8H30 2024-09-11T01:14:20.032 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.KLz7hT8H30 is 371KB 2024-09-11T01:14:20.122 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.KLz7hT8H30 2024-09-11T01:14:20.161 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T01:14:20.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T01:14:20.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T01:14:20.293 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T01:14:20.350 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T01:14:20.350 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T01:14:20.352 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi081/crash 2024-09-11T01:14:20.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T01:14:20.409 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi167/crash 2024-09-11T01:14:20.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T01:14:20.464 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T01:14:20.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:20.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:20.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:20.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T01:14:20.705 INFO:tasks.ceph:Compressing logs... 2024-09-11T01:14:20.705 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T01:14:20.709 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T01:14:20.774 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93970.log 2024-09-11T01:14:20.775 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T01:14:20.776 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2024-09-11T01:14:20.776 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.93970.log.gz 2024-09-11T01:14:20.777 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37379.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36002.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35962.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.35962.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T01:14:20.790 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36122.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36162.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36122.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35962.log.gz 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36002.log.gz 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2024-09-11T01:14:20.791 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T01:14:20.792 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36202.log 2024-09-11T01:14:20.792 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50971.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93718.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51920.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93508.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93718.log.gz 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93508.log.gz 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51836.log 2024-09-11T01:14:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44478.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50587.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50460.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50587.log.gz 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50038.log: /var/log/ceph/ceph-client.admin.43312.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50460.log.gz 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94096.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93466.log 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51920.log.gz 2024-09-11T01:14:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94096.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30071.log 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.94096.log.gz 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92683.log 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.93466.log.gz 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.30071.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph.tmp-client.admin.30071.log.gz --verbose 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.41760.log 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50971.log.gz 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92683.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92683.log.gz 2024-09-11T01:14:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93127.log 2024-09-11T01:14:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-09-11T01:14:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2024-09-11T01:14:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43300.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93127.log.gz 2024-09-11T01:14:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94138.log 2024-09-11T01:14:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T01:14:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43986.log: /var/log/ceph/ceph-client.admin.94138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93676.log 2024-09-11T01:14:20.799 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94138.log.gz 2024-09-11T01:14:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-09-11T01:14:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2024-09-11T01:14:20.800 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93676.log.gz 2024-09-11T01:14:20.800 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37379.log.gz 2024-09-11T01:14:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-09-11T01:14:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92964.log 2024-09-11T01:14:20.801 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-09-11T01:14:20.801 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-09-11T01:14:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36689.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-09-11T01:14:20.802 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-09-11T01:14:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49972.log 2024-09-11T01:14:20.803 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2024-09-11T01:14:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92964.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-09-11T01:14:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51447.log 2024-09-11T01:14:20.804 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92964.log.gz 2024-09-11T01:14:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72774.log 2024-09-11T01:14:20.804 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44478.log.gz 2024-09-11T01:14:20.804 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-09-11T01:14:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52360.log 2024-09-11T01:14:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52793.log 2024-09-11T01:14:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52360.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72774.log.gz 2024-09-11T01:14:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94012.log 2024-09-11T01:14:20.806 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2024-09-11T01:14:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-09-11T01:14:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2024-09-11T01:14:20.808 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94012.log.gz 2024-09-11T01:14:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2024-09-11T01:14:20.809 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz 2024-09-11T01:14:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49929.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51836.log.gz 2024-09-11T01:14:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45017.log 2024-09-11T01:14:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92617.log 2024-09-11T01:14:20.811 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2024-09-11T01:14:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.45017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2024-09-11T01:14:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2024-09-11T01:14:20.811 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2024-09-11T01:14:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92617.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-09-11T01:14:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94718.log 2024-09-11T01:14:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43313.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.92617.log.gz 2024-09-11T01:14:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51141.log 2024-09-11T01:14:20.813 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2024-09-11T01:14:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42882.log 2024-09-11T01:14:20.813 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94718.log.gz 2024-09-11T01:14:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51963.log 2024-09-11T01:14:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51622.log 2024-09-11T01:14:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-09-11T01:14:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94466.log 2024-09-11T01:14:20.817 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51141.log.gz 2024-09-11T01:14:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93550.log 2024-09-11T01:14:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59136.log 2024-09-11T01:14:20.819 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51963.log.gz 2024-09-11T01:14:20.819 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 87.6% 2024-09-11T01:14:20.819 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94466.log.gz 2024-09-11T01:14:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73317.log 2024-09-11T01:14:20.821 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.93550.log.gz 2024-09-11T01:14:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36401.log 2024-09-11T01:14:20.821 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59136.log.gz 2024-09-11T01:14:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2024-09-11T01:14:20.823 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.73317.log.gz 2024-09-11T01:14:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72127.log 2024-09-11T01:14:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52317.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-09-11T01:14:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-09-11T01:14:20.825 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2024-09-11T01:14:20.825 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-09-11T01:14:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41422.log 2024-09-11T01:14:20.825 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.72127.log.gz 2024-09-11T01:14:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45239.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52793.log.gz 2024-09-11T01:14:20.826 INFO:teuthology.orchestra.run.smithi081.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36401.log.gz 2024-09-11T01:14:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52750.log 2024-09-11T01:14:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36128.log 2024-09-11T01:14:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-09-11T01:14:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36128.log.gz 2024-09-11T01:14:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50778.log 2024-09-11T01:14:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-09-11T01:14:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50778.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-09-11T01:14:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2024-09-11T01:14:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94508.log 2024-09-11T01:14:20.831 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52750.log.gz 2024-09-11T01:14:20.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-09-11T01:14:20.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2024-09-11T01:14:20.831 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94508.log.gz 2024-09-11T01:14:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59625.log 2024-09-11T01:14:20.832 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-09-11T01:14:20.832 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-09-11T01:14:20.832 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2024-09-11T01:14:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2024-09-11T01:14:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92555.log 2024-09-11T01:14:20.833 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59625.log.gz 2024-09-11T01:14:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2024-09-11T01:14:20.834 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2024-09-11T01:14:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36191.log 2024-09-11T01:14:20.835 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92555.log.gz 2024-09-11T01:14:20.835 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51622.log.gz 2024-09-11T01:14:20.835 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51447.log.gz 2024-09-11T01:14:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-09-11T01:14:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94180.log 2024-09-11T01:14:20.837 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41294.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T01:14:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94760.log 2024-09-11T01:14:20.838 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94180.log.gz 2024-09-11T01:14:20.839 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73085.log 2024-09-11T01:14:20.840 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94760.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49972.log.gz 2024-09-11T01:14:20.840 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-09-11T01:14:20.840 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94760.log.gz 2024-09-11T01:14:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73085.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz 2024-09-11T01:14:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36619.log 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52360.log.gz 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53029.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.73085.log.gz 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.36191.log.gz 2024-09-11T01:14:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41508.log 2024-09-11T01:14:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-09-11T01:14:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2024-09-11T01:14:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93802.log 2024-09-11T01:14:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52859.log 2024-09-11T01:14:20.846 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94424.log 2024-09-11T01:14:20.846 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93802.log.gz 2024-09-11T01:14:20.847 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72731.log 2024-09-11T01:14:20.848 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-09-11T01:14:20.848 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94424.log.gz 2024-09-11T01:14:20.849 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72731.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72731.log.gz 2024-09-11T01:14:20.849 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92726.log 2024-09-11T01:14:20.850 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-11T01:14:20.851 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36662.log 2024-09-11T01:14:20.851 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.92726.log.gz 2024-09-11T01:14:20.851 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50313.log: 86.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.36619.log.gz -5 --verbose 2024-09-11T01:14:20.851 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.36659.log 2024-09-11T01:14:20.852 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36662.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2024-09-11T01:14:20.852 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2024-09-11T01:14:20.853 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41508.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36659.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36662.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2024-09-11T01:14:20.854 INFO:teuthology.orchestra.run.smithi081.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36659.log.gz 2024-09-11T01:14:20.855 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-09-11T01:14:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93634.log 2024-09-11T01:14:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2024-09-11T01:14:20.856 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36202.log: /var/log/ceph/ceph-mds.f.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-09-11T01:14:20.856 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36202.log.gz 2024-09-11T01:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49127.log 2024-09-11T01:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2024-09-11T01:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93634.log.gz 2024-09-11T01:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51014.log 2024-09-11T01:14:20.858 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2024-09-11T01:14:20.858 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2024-09-11T01:14:20.859 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2024-09-11T01:14:20.859 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-09-11T01:14:20.859 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51014.log.gz 2024-09-11T01:14:20.860 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2024-09-11T01:14:20.860 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2024-09-11T01:14:20.861 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45665.log 2024-09-11T01:14:20.861 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2024-09-11T01:14:20.862 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gz 2024-09-11T01:14:20.862 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51513.log 2024-09-11T01:14:20.863 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41166.log 2024-09-11T01:14:20.864 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41208.log 2024-09-11T01:14:20.865 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T01:14:20.865 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2024-09-11T01:14:20.866 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93592.log 2024-09-11T01:14:20.866 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T01:14:20.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-09-11T01:14:20.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52902.log 2024-09-11T01:14:20.867 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93592.log.gz 2024-09-11T01:14:20.868 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51513.log.gz 2024-09-11T01:14:20.868 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92835.log 2024-09-11T01:14:20.869 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52251.log 2024-09-11T01:14:20.869 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-09-11T01:14:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41466.log 2024-09-11T01:14:20.871 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92835.log.gz 2024-09-11T01:14:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94324.log 2024-09-11T01:14:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-11T01:14:20.872 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43651.log 2024-09-11T01:14:20.872 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94324.log.gz 2024-09-11T01:14:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94550.log 2024-09-11T01:14:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-09-11T01:14:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94550.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52251.log.gz 2024-09-11T01:14:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2024-09-11T01:14:20.875 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94550.log.gz 2024-09-11T01:14:20.875 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-11T01:14:20.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59286.log 2024-09-11T01:14:20.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93084.log 2024-09-11T01:14:20.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2024-09-11T01:14:20.878 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59286.log.gz 2024-09-11T01:14:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93084.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93084.log.gz 2024-09-11T01:14:20.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43651.log.gz /var/log/ceph/ceph-client.admin.36275.log 2024-09-11T01:14:20.879 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-11T01:14:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52623.log 2024-09-11T01:14:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57708.log 2024-09-11T01:14:20.881 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2024-09-11T01:14:20.881 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-09-11T01:14:20.881 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-09-11T01:14:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94634.log 2024-09-11T01:14:20.882 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2024-09-11T01:14:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-09-11T01:14:20.882 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36275.log.gz 2024-09-11T01:14:20.882 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57708.log.gz 2024-09-11T01:14:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2024-09-11T01:14:20.883 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94634.log.gz 2024-09-11T01:14:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36738.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52623.log.gz 2024-09-11T01:14:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36775.log 2024-09-11T01:14:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50735.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T01:14:20.885 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92792.log 2024-09-11T01:14:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-09-11T01:14:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36709.log 2024-09-11T01:14:20.887 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92792.log.gz 2024-09-11T01:14:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-11T01:14:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44268.log 2024-09-11T01:14:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-09-11T01:14:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73274.log 2024-09-11T01:14:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41338.log 2024-09-11T01:14:20.891 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2024-09-11T01:14:20.891 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73274.log.gz 2024-09-11T01:14:20.892 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49526.log 2024-09-11T01:14:20.892 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-09-11T01:14:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2024-09-11T01:14:20.893 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-09-11T01:14:20.894 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94054.log 2024-09-11T01:14:20.895 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2024-09-11T01:14:20.895 INFO:teuthology.orchestra.run.smithi081.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36775.log.gz 2024-09-11T01:14:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94054.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36709.log.gz 2024-09-11T01:14:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52142.log 2024-09-11T01:14:20.896 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94054.log.gz 2024-09-11T01:14:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-09-11T01:14:20.897 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-11T01:14:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52142.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T01:14:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2024-09-11T01:14:20.898 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-09-11T01:14:20.899 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2024-09-11T01:14:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40850.log 2024-09-11T01:14:20.899 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49127.log.gz 2024-09-11T01:14:20.899 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44268.log.gz 2024-09-11T01:14:20.900 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2024-09-11T01:14:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-09-11T01:14:20.901 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2024-09-11T01:14:20.901 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T01:14:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48975.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42882.log.gz 2024-09-11T01:14:20.902 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-09-11T01:14:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93225.log 2024-09-11T01:14:20.903 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-09-11T01:14:20.904 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49526.log.gz 2024-09-11T01:14:20.904 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-09-11T01:14:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41250.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-09-11T01:14:20.904 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz -5 2024-09-11T01:14:20.904 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58945.log 2024-09-11T01:14:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93225.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2024-09-11T01:14:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42252.log 2024-09-11T01:14:20.905 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2024-09-11T01:14:20.905 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93225.log.gz 2024-09-11T01:14:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94384.log 2024-09-11T01:14:20.906 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2024-09-11T01:14:20.906 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.58945.log.gz 2024-09-11T01:14:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50503.log 2024-09-11T01:14:20.906 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2024-09-11T01:14:20.907 INFO:teuthology.orchestra.run.smithi167.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36122.log.gz 2024-09-11T01:14:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-09-11T01:14:20.907 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.94384.log.gz 2024-09-11T01:14:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49356.log 2024-09-11T01:14:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T01:14:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2024-09-11T01:14:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-09-11T01:14:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2024-09-11T01:14:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49236.log 2024-09-11T01:14:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49399.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-09-11T01:14:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93283.log 2024-09-11T01:14:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2024-09-11T01:14:20.913 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49356.log.gz 2024-09-11T01:14:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93283.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.93283.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59668.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49236.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59668.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41064.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36381.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-09-11T01:14:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72540.log 2024-09-11T01:14:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2024-09-11T01:14:20.922 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36381.log.gz 2024-09-11T01:14:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72540.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51665.log 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.72540.log.gz 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50862.log 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37287.log 2024-09-11T01:14:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94222.log 2024-09-11T01:14:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37287.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52859.log.gz 2024-09-11T01:14:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36752.log 2024-09-11T01:14:20.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-09-11T01:14:20.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94222.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52902.log.gz 2024-09-11T01:14:20.925 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.94222.log.gz 2024-09-11T01:14:20.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52986.log 2024-09-11T01:14:20.926 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41422.log.gz 2024-09-11T01:14:20.927 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41466.log.gz 2024-09-11T01:14:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37086.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-09-11T01:14:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2024-09-11T01:14:20.928 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45665.log.gz 2024-09-11T01:14:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-09-11T01:14:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-09-11T01:14:20.929 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2024-09-11T01:14:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72861.log 2024-09-11T01:14:20.930 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2024-09-11T01:14:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50229.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52142.log.gz 2024-09-11T01:14:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2024-09-11T01:14:20.931 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51665.log.gz 2024-09-11T01:14:20.931 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36752.log.gz 2024-09-11T01:14:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2024-09-11T01:14:20.932 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72861.log.gz 2024-09-11T01:14:20.932 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52986.log.gz 2024-09-11T01:14:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45622.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-09-11T01:14:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51098.log 2024-09-11T01:14:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52487.log 2024-09-11T01:14:20.933 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2024-09-11T01:14:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36583.log 2024-09-11T01:14:20.934 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2024-09-11T01:14:20.934 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-09-11T01:14:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-09-11T01:14:20.935 INFO:teuthology.orchestra.run.smithi167.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-11T01:14:20.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2024-09-11T01:14:20.936 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2024-09-11T01:14:20.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-09-11T01:14:20.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93760.log 2024-09-11T01:14:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45155.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51098.log.gz 2024-09-11T01:14:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36728.log 2024-09-11T01:14:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-09-11T01:14:20.939 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93760.log.gz 2024-09-11T01:14:20.940 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52487.log.gz 2024-09-11T01:14:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-09-11T01:14:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42798.log 2024-09-11T01:14:20.941 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.41718.log: -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2024-09-11T01:14:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2024-09-11T01:14:20.942 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50503.log.gz 2024-09-11T01:14:20.942 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50778.log.gz 2024-09-11T01:14:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-09-11T01:14:20.942 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36583.log.gz 2024-09-11T01:14:20.942 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-09-11T01:14:20.943 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2024-09-11T01:14:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52099.log 2024-09-11T01:14:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44607.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-09-11T01:14:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42654.log 2024-09-11T01:14:20.944 INFO:teuthology.orchestra.run.smithi081.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36728.log.gz 2024-09-11T01:14:20.944 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-09-11T01:14:20.945 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42798.log.gz 2024-09-11T01:14:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52099.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2024-09-11T01:14:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz -5 2024-09-11T01:14:20.946 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2024-09-11T01:14:20.946 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52099.log.gz 2024-09-11T01:14:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2024-09-11T01:14:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-09-11T01:14:20.947 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2024-09-11T01:14:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43635.log 2024-09-11T01:14:20.948 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2024-09-11T01:14:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94592.log 2024-09-11T01:14:20.949 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59179.log 2024-09-11T01:14:20.950 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43635.log.gz 2024-09-11T01:14:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2024-09-11T01:14:20.950 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94592.log.gz 2024-09-11T01:14:20.951 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36103.log 2024-09-11T01:14:20.951 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43872.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37287.log.gz 2024-09-11T01:14:20.952 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59179.log.gz 2024-09-11T01:14:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42696.log 2024-09-11T01:14:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36103.log.gz 2024-09-11T01:14:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-09-11T01:14:20.952 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz 2024-09-11T01:14:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2024-09-11T01:14:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49193.log 2024-09-11T01:14:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41676.log 2024-09-11T01:14:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93416.log 2024-09-11T01:14:20.956 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.42252.log.gz 2024-09-11T01:14:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94264.log 2024-09-11T01:14:20.957 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49193.log.gz 2024-09-11T01:14:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51320.log 2024-09-11T01:14:20.957 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93416.log.gz 2024-09-11T01:14:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59488.log 2024-09-11T01:14:20.958 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.94264.log.gz 2024-09-11T01:14:20.959 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92921.log 2024-09-11T01:14:20.959 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59488.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41676.log.gz 2024-09-11T01:14:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-09-11T01:14:20.961 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.59488.log.gz 2024-09-11T01:14:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92921.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-11T01:14:20.961 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92921.log.gz 2024-09-11T01:14:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45281.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51320.log.gz 2024-09-11T01:14:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-09-11T01:14:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-09-11T01:14:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2024-09-11T01:14:20.963 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-09-11T01:14:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50356.log 2024-09-11T01:14:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-09-11T01:14:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93886.log 2024-09-11T01:14:20.965 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2024-09-11T01:14:20.966 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-09-11T01:14:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T01:14:20.967 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2024-09-11T01:14:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2024-09-11T01:14:20.967 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93886.log.gz 2024-09-11T01:14:20.967 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42654.log.gz 87.5% 2024-09-11T01:14:20.968 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42696.log.gz 2024-09-11T01:14:20.968 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-09-11T01:14:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T01:14:20.969 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2024-09-11T01:14:20.969 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-09-11T01:14:20.969 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-09-11T01:14:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93928.log 2024-09-11T01:14:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52444.log 2024-09-11T01:14:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-09-11T01:14:20.971 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93928.log.gz 2024-09-11T01:14:20.971 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T01:14:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-09-11T01:14:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93844.log 2024-09-11T01:14:20.973 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52444.log.gz 2024-09-11T01:14:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-09-11T01:14:20.973 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-09-11T01:14:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2024-09-11T01:14:20.974 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.93844.log.gz 2024-09-11T01:14:20.974 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7%/var/log/ceph/ceph-client.admin.43955.log: -- replaced with /var/log/ceph/ceph-client.admin.40850.log.gz 2024-09-11T01:14:20.975 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2024-09-11T01:14:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43989.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50862.log.gz 2024-09-11T01:14:20.977 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50356.log.gz 2024-09-11T01:14:20.977 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-09-11T01:14:20.979 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-09-11T01:14:20.980 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2024-09-11T01:14:20.993 INFO:teuthology.orchestra.run.smithi167.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T01:14:20.997 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-09-11T01:14:21.101 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2024-09-11T01:14:21.110 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41166.log.gz 2024-09-11T01:14:21.110 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41208.log.gz 2024-09-11T01:14:21.110 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-09-11T01:14:21.111 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-09-11T01:14:21.111 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41338.log.gz 2024-09-11T01:14:21.111 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-09-11T01:14:21.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-11T01:14:21.514 INFO:teuthology.orchestra.run.smithi081.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T01:14:22.324 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T01:14:22.456 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-09-11T01:14:22.497 INFO:teuthology.orchestra.run.smithi081.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-11T01:14:22.927 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T01:14:25.452 INFO:teuthology.orchestra.run.smithi167.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T01:14:25.849 INFO:teuthology.orchestra.run.smithi167.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T01:14:28.531 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T01:14:41.091 INFO:teuthology.orchestra.run.smithi081.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T01:15:58.969 INFO:teuthology.orchestra.run.smithi167.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T01:16:09.978 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T01:16:51.186 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T01:17:16.145 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T01:17:49.559 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T01:18:08.364 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T01:19:11.022 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T01:19:11.277 INFO:teuthology.orchestra.run.smithi081.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.0.45017.log.gz 2024-09-11T01:19:11.280 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-11T01:19:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:real 4m50.543s 2024-09-11T01:19:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:user 6m14.837s 2024-09-11T01:19:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m43.671s 2024-09-11T01:19:24.005 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T01:19:29.474 INFO:teuthology.orchestra.run.smithi167.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T01:19:29.477 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-11T01:19:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:real 5m8.735s 2024-09-11T01:19:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:user 4m55.770s 2024-09-11T01:19:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m30.966s 2024-09-11T01:19:29.479 INFO:tasks.ceph:Archiving logs... 2024-09-11T01:19:29.479 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi081/log 2024-09-11T01:19:29.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T01:20:26.911 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi167/log 2024-09-11T01:20:26.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T01:21:17.891 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T01:21:17.901 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T01:21:17.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T01:21:17.907 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T01:21:18.072 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T01:21:18.081 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T01:21:18.081 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:21:18.085 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:21:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:21:18.118 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -776us[ -767us] +/- 42ms 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +1498us[+1507us] +/- 64ms 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -560us[ -551us] +/- 87ms 2024-09-11T01:21:18.207 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -731us[ -726us] +/- 42ms 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 +1521us[+1526us] +/- 64ms 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -539us[ -534us] +/- 87ms 2024-09-11T01:21:18.239 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:21:18.252 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T01:21:18.262 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T01:21:18.262 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T01:21:18.271 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T01:21:18.415 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T01:21:18.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T01:21:18.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:21:18.610 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T01:21:18.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:21:18.670 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T01:21:18.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T01:21:18.697 INFO:teuthology.task.internal:Duration was 2694.661142 seconds 2024-09-11T01:21:18.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T01:21:18.706 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T01:21:18.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T01:21:18.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T01:21:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:21:18.823 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:21:19.296 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T01:21:19.296 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-11T01:21:19.297 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T01:21:19.346 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T01:21:19.346 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T01:21:19.401 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T01:21:19.401 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T01:21:19.406 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T01:21:19.470 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T01:21:19.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T01:21:19.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T01:21:19.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T01:21:19.657 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T01:21:19.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T01:21:19.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T01:21:19.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T01:21:19.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:21:19.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:21:19.888 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-11T01:21:19.907 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-11T01:21:19.971 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:21:20.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:21:20.004 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:21:20.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:21:20.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T01:21:20.047 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T01:21:20.049 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi081 2024-09-11T01:21:20.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T01:21:20.113 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899851/remote/smithi167 2024-09-11T01:21:20.114 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T01:21:20.176 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T01:21:20.177 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T01:21:20.181 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T01:21:20.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T01:21:20.226 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T01:21:20.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T01:21:20.237 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T01:21:20.237 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T01:21:20.256 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T01:21:20.286 INFO:teuthology.orchestra.run.smithi081.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 01:21 /home/ubuntu/cephtest 2024-09-11T01:21:20.291 INFO:teuthology.orchestra.run.smithi167.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 01:21 /home/ubuntu/cephtest 2024-09-11T01:21:20.293 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T01:21:20.303 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T01:21:20.325 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/ffsb}} duration: 2694.6611416339874 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-11T01:21:20.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T01:21:20.426 INFO:teuthology.run:pass